IN THF SPECIFICATION 

Please amend the application by entering the enclosed substitute specification in place of 
that which was previously filed. A redlined copy of the specification is also attached 
incorporating the changes. 



DC157973 .DOC 



2 



SadOl-2117 
•CLEAN VERSION 



Attorney Docket No. : SON-2 1 1 7 
Application No.: 09/874,061 




FIR FILTER AND SETTING METHOD OF COEFFICIENT THEREOF 




BACKGROUND OF THE INVENTION 



1. 



Field of the Invention 



The present invention relates to an FIR filter and method of setting 



coefficients of the FER filter that are necessary for digital signal processing. 
2. Description of the Related Art 

In the digital signal processing for picture and/or voice, filter processing is often 
used. Linear-phase FIR (Finite Impulse Response) filter is often utilized as the filter for 
digital signal processing of picture and/or voice in that the linear-phase FIR filter has the 
characteristics that its number of taps is finite and has a linear-phase. 



of the linear-phase FIR filter. 

The linear-phase FIR filter 1, as illustrated in Fig.l, has (n - 1) delay units 2-1 to 

2- (n-l) that constitute a shift register connected to an input terminal Tin with cascade 
connection, n multipliers 3-1 to 3-n for multiplying a signal input to the input terminal 
Tin and output signals of respective delay units 2-1 to 2-(n-l) by filter coefficients h (0) 
to h (n-1) respectively, and an adder 4 for adding n output signals of the multipliers 3-1 to 

3- n to output to an output terminal Tout- 

As a typical method for designing such the linear-phase FIR filter, for instance, 
these are known Remez Exchange algorithms which Parks, T.W. and McCleLLan, J.H. et 
al. apply it to the linear-phase FIR filter (Parks, T.W. and McClellan, J.H.: "Chebyshev 
Approximation for Non-recursive Digital Filters with Linear Phase", IEEE Trans. Circuit 
Theory, CT-19, 2,pp.l89-194, 1972, as well as Rabiner, L.R., McClellan, J.H. and Parks, 
T.W.: "FIR Digital Filter Design Techniques Using Weighted Chebyshev 
Approximation", Proc. IEEE, Vol 63, April, pp.595-610, 1975). 

The Remez Exchange algorithm is an algorithm in which a weighted 
approximation error is approximated such that the weighted approximation error is made 
to configure equi-ripple to the desired amplitude characteristics. 



Fig.l is a view illustrating circuit configuration of a transversal type filter 
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There is known a resolution conversion of a picture that utilizes the sampling rate 
conversion as the application of the filter processing using the linear-phase FIR filter. 

In this resolution conversion, multi-rate filter which has an interpolator, a 
decimeter and the linear-phase FIR filter as element-technique is employed (see, 
P.P.Vaidyanathan: "Multirate System and Filter Banks", Prentice Hall, 1992). 

In use of the multi-rate filter, generally, the linear-phase FIR filter is made to be 
used in such a way as to execute a polyphase-sort (dissolution) in order to adjust the 
interpolator. Both the interpolator and the decimeter form periodic time invariance 
systems, thus having different characteristics from the time invariance system. 

Distortion so called as the chessboard distortion on a lattice occurs in the 
resolution conversion of the picture caused by the periodic time invariance property of 
the interpolator. 

Accordingly, Harada, and Takaie considered the condition for avoiding such 
chessboard distortion from the viewpoint of a zero-point arrangement of a filter (see, 
Yasuhiro Harada, Hitoshi Kiya,: "Multi-rate Filter without Accompanying Chessboard 
Distortion and its Zero-point Arrangement" The technical Report of IEICE CAS96-78, 
ppl-6, 1997-01). 

A transfer function H (z) for the multi-rate filter without accompanying the 
chessboard distortion will be discussed. The transfer function H (z) is capable of being 
found in such a way as to multiply a transfer function K (z) of the linear-phase FIR filter 
(hereinafter referred to as an equalizer) designed by a method in some kind by the 
transfer function Z (z) of the zero-point in order to avoid the chessboard distortion later. 

H(z)** Z(z)* K(z) (1) 

Here, a linear-phase FIR filter fixed beforehand such as the transfer function Z (z) 
of the zero-point for avoiding the chessboard distortion is called as a pre-filter. 
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Fig.2 shows an example of a frequency response of the multi-rate filter and a 
weighted approximation error, in which the chessboard distortion is avoided by 
multiplying the equalizer designed by the use of Remez Exchange algorithms and the 
pre-filter. 

However, it suffers from the disadvantage in the avoiding method of the 
chessboard distortion according to the aforementioned method. 

Namely, as illustrated in Fig. 2C, in the multi-rate filter having the transfer 
function H (z) designed depending on the conventional method, the equi-ripple of the 
weighted approximation error designed depending on the Remez Exchange algorithms is 
not established. 

Further, as illustrated in Fig. 2B, the multi-rate filter designed depending on the 
conventional method, has a gain of its pass band with non-fixed value in which a right 
end is attenuated. 

If the resolution conversion is executed using such filter, contours of 
picture appears fuzzy and thus, adversely affect quality of the picture. 

The attenuation of this pass band cannot be avoided even though the 
number of coefficient of filter is increased. 

SUMMARY OF THE INVENTION 

An object of the present invention is to provide an FIR filter and setting method 
of its coefficients in which the equi-ripple of the weighted approximation error is not 
established, and further it is possible to maintain a gain of the pass band at approximately 
a constant value. 

In order to achieve the above-mentioned objects, an FIR filter of the present 
invention has a configuration in which an impulse response is expressed by using a finite 
time length. This impulse response is equivalent to a filter coefficient of the FIR filter, 
and the FIR filter's transfer function H (z) is related to a transfer function Z (z) of a pre- 
filter, wherein the filter coefficient is set by performing a weighted approximation to the 
desired characteristics in relation to the frequency response of the pre-filter. 
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Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length. This impulse response 
is equivalent to a filter coefficient of the FIR filter, and whose transfer function H (z) is 
related to a transfer function Z (z) of a pre-filter, and a transfer function K (z) of an 
equalizer, wherein the filter coefficient is set on the basis of an amplitude characteristic 
of the equalizer that is obtained in such a way as to execute a weighted approximation to 
the desired characteristics in relation to a frequency response of the pre-filter. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length, this impulse response is equivalent to a filter coefficient of the FIR 
filter, and whose transfer function H (z) is related to a transfer function Z (z) of a pre- 
filter, wherein the filter coefficient is calculated by performing a weighted approximation 
to the desired characteristics in relation to a frequency response of the pre-filter. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length. This impulse response is equivalent to a filter coefficient of the FIR 
filter, and whose transfer function H (z) is related to a transfer function Z (z) of a pre- 
filter and a transfer function K (z) of an equalizer, wherein the filter coefficient is 
calculated depending on an amplitude characteristic of the equalizer, which is obtained in 
such a way as to execute a weighted approximation to the desired characteristics in 
relation to a frequency response of the pre-filter. 

Also, a setting method of filter coefficients of an FIR filter of the present 
invention has a method in which weighted approximation is executed to the desired 
characteristics by using Remez Exchange algorithms taking into account a frequency 
response of a pre-filter. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by a finite 
time length. This impulse response is equivalent to a filter coefficient. The setting method 
of a filter coefficient of the FIR filter comprises: a first step for generating an 
interpolation polynomial equation for interpolating an amplitude characteristic from an 
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extreme value point of the amplitude characteristic of a frequency; a second step for 
determining a new extreme value point from the amplitude characteristic obtained from 
the interpolation polynomial equation that is generated in the first step; a third step for 
judging whether or not a position of the extreme value is approximated within a required 
range by repeating the operation in the first step and the second step; and a fourth step for 
finding the filter coefficient from the approximated amplitude characteristic obtained in 
the third step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which there is further provided an initial setting step for 
carrying out, at least, setting of the FIR filter, setting of the band, setting of coefficient of 
a pre-filter, and setting of initial extreme value point, before executing the operation the 
first step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method wherein, in the second step and the third step, the extreme- value 
of weighted approximation error calculated from the extreme- value point used for the 
interpolation is searched for the entire approximation band, then an obtained extreme- 
value is taken to be a new extreme-value point, and it is judged that the optimum 
approximation is obtained when the position of the extreme- value is not changed. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which, in the fourth step, the filter coefficient is calculated by 
performing a weighted approximation to the desired characteristics in relation to a 
frequency response of the pre-filter. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which, in the fourth step, the filter coefficient is calculated 
depending on an amplitude characteristic of the equalizer obtained in such a way as to 
execute a weighted approximation to the desired characteristics in relation to a frequency 
response of the pre-filter. 

Also, according to the invention an FIR filter has an impulse response expressed 
by using a finite time length, the impulse response being equivalent to a filter coefficient 
of the FER filter, the FIR filter having an arbitrary number of taps, and whose transfer 
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function H (z) is related to a transfer function Z (z) of a pre-filter, wherein the filter 
coefficient is set in such a way as to perform a weighted approximation to the desired 
characteristics so as to satisfy an attenuation quantity of a stop band in relation to a 
frequency response of the pre-filter which satisfies the attenuation quantity of the stop 
band, when the number of taps is variable and the bandwidth is fixed. 

Also, an FIR filter has an impulse response expressed by using a finite time 
length, the impulse response being equivalent to a filter coefficient of the FIR filter, the 
FER filter having an arbitrary number of taps, and whose transfer function H (z) is related 
to a transfer function Z (z) of a pre-filter and transfer function K (z) of an equalizer, 
wherein the filter coefficient is set on the basis of an amplitude characteristic of the 
equalizer obtained in such a way as to perform a weighted approximation to the desired 
characteristics so as to satisfy an attenuation quantity of a stop band in relation to a 
frequency response of the pre-filter which satisfies the attenuation quantity of the stop 
band, when the number of taps is variable and the bandwidth is fixed. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length wherein, this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FER filter has arbitrary number of taps, and whose transfer function H (z) is 
related to a transfer function Z (z) of a pre-filter, wherein the filter coefficient is 
calculated by performing a weighted approximation to the desired characteristics so as to 
satisfy an attenuation quantity of a stop band in relation to the frequency response of the 
pre-filter which satisfies an attenuation quantity of the stop band, when the band is fixed 
and the number of taps is made variable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FIR filter has an arbitrary number of taps, and whose transfer function H 
(z) is related to a transfer function Z (z) of a pre-filter and a transfer function K (z) of an 
equalizer, wherein the filter coefficient is calculated depending on an amplitude 
characteristic of the equalizer obtained in such a way as to execute a weighted 
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approximation to the desired characteristics so as to satisfy an attenuation quantity of a 
stop band in relation to the frequency response of the pre-filter which satisfies an 
attenuation quantity of the stop band, when the band is fixed and the number of taps is 
made variable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length, in which this impulse response is equivalent to a filter coefficient of 
the FIR filter, and the FIR filter's number of tap is variable, and whose band is fixed, 
which the setting method of a filter coefficient of an FIR filter comprises the steps of: a 
first step for generating an interpolation polynomial equation for interpolating an 
amplitude characteristic from an extreme value point of the amplitude characteristic of 
the frequency; a second step for determining a new extreme value point from the 
amplitude characteristic obtained from the interpolation polynomial equation that is 
obtained in the first step; a third step forjudging whether or not a position of the extreme 
value is approximated within a required range while repeating the first step and the 
second step; a fourth step for examining an attenuation quantity of a stop band from the 
approximated amplitude characteristic obtained in the third step; a fifth step for 
comparing the examined attenuation quantity with the attenuation quantity of the stop 
band thus designated to judge whether or not a result of the comparison satisfies a 
predetermined condition; a sixth step for changing the number of taps when a result of 
the comparison of the fifth step does not satisfy the predetermined condition; and a 
seventh step for finding the filter coefficient from the amplitude characteristic thus 
approximated depending on the third step which satisfies the predetermined condition in 
the fifth step. 

Also a method of setting filter coefficients of an FIR filter of the present invention 
has a method, wherein there is provided at least an initial setting step for carrying out a 
setting of the FIR filter, setting of the band, setting of a coefficient of a pre-filter, and 
setting of an initial extreme value point, before executing the first step. 
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Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method, in the fourth step, in which the minimum attenuation quantity in 
the stop band is examined, and in the sixth step, the number of the taps is increased. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method, in the above described seventh step, in which the filter 
coefficient is calculated by performing a weighted approximation with reference to the 
desired characteristics so as to satisfy an attenuation quantity of a stop band in relation to 
a frequency response of the pre- filter that satisfies the attenuation quantity of the stop 
band when a band is fixed and the number of taps is made variable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method, in the above described seventh step, in which the filter 
coefficient is calculated depending on an amplitude characteristic of an equalizer 
obtained in such a way as to execute a weighted approximation with reference to the 
desired characteristics so as to satisfy an attenuation quantity of a stop band in relation to 
frequency response of the pre-filter that satisfies the attenuation quantity of the stop band 
when a band is fixed and the number of taps is made variable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, where in this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has an 
arbitrary number of taps, and whose transfer function H (z) is related to a transfer 
function Z (z) of a pre-filter, wherein the filter coefficient is set in such a way as to 
execute a weighted approximation to the desired characteristics so as to satisfy an 
attenuation quantity of a stop band in relation to a frequency response of the pre-filter 
which satisfies an attenuation quantity of a stop band, when the number of taps is fixed 
and band setting is changeable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, wherein this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has arbitrary 
number of taps, and whose transfer function H (z) is related to a transfer function Z (z) of 
a pre-filter and transfer function K (z) of an equalizer, wherein the filter coefficient is set 
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on the basis of an amplitude characteristic of the equalizer obtained in such a way as to 
execute a weighted approximation to the desired characteristics so as to satisfy an 
attenuation quantity of a stop band in relation to frequency response of the pre-filter 
which satisfies an attenuation quantity of a stop band, when the number of taps is fixed 
and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FIR filter has arbitrary number of taps, and whose transfer function H (z) is 
related to a transfer function Z (z) of a pre-filter, wherein the filter coefficient is 
calculated by performing a weighted approximation to the desired characteristics so as to 
satisfy an attenuation quantity of a stop band in relation to the frequency response of the 
pre-filter which satisfies an attenuation quantity of the stop band, when the number of 
taps is fixed and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length, this impulse response is equivalent to a filter coefficient of the FIR 
filter, the FIR filter has arbitrary number of taps, and whose transfer function H (z) is 
related to a transfer function Z (z) of a pre-filter and a transfer function K (z) of an 
equalizer, wherein the filter coefficient is calculated depending on an amplitude 
characteristic of the equalizer obtained in such a way as to execute a weighted 
approximation to the desired characteristics so as to satisfy an attenuation quantity of a 
stop band in relation to the frequency response of the pre-filter which satisfies an 
attenuation quantity of the stop band, when the number of taps is fixed and band setting is 
changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, and the FIR filter's number of taps is fixed, and whose band setting is 
changeable, the setting method of a filter coefficient of an FIR filter comprises the steps 
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of: a first step for generating an interpolation polynomial equation for interpolating an 
amplitude characteristic from an extreme value point of the amplitude characteristic of 
the frequency; a second step for determining a new extreme value point from the 
amplitude characteristic obtained from the interpolation polynomial equation that is 
obtained in the first step; a third step forjudging whether or not a position of the extreme 
value is approximated within a required range while repeating the first step and the 
second step; a fourth step for examining an attenuation quantity of a stop band from the 
approximated amplitude characteristic obtained in the third step; a fifth step for 
comparing the examined attenuation quantity with the attenuation quantity of the stop 
band thus designated to judge whether or not a result of the comparison satisfies a 
predetermined condition; a sixth step for changing the band setting when a result of the 
comparison of the fifth step does not satisfy the predetermined condition; and a seventh 
step for finding the filter coefficient from the amplitude characteristic thus approximated 
depending on the third step which satisfies the predetermined condition in the fifth step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method, wherein there is provided an initial setting step for carrying out, 
at least, setting of the FIR filter, setting of the band, setting of a coefficient of a pre-filter, 
and setting of an initial extreme value point, before executing the first step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method, in the fourth step, in which the minimum attenuation quantity in 
the stop band is examined. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention, in the above described seventh step, has a step the filter coefficient is 
calculated by performing a weighted approximation with reference to the desired 
characteristics so as to satisfy an attenuation quantity of a stop band in relation to a 
frequency response of the pre-filter that satisfies the attenuation quantity of the stop band 
when the number of taps is fixed and the band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a method, in the above described seventh step, wherein the filter coefficient 
is calculated depending on an amplitude characteristic of an equalizer obtained in such a 
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way as to execute a weighted approximation with reference to the desired characteristics 
so as to satisfy an attenuation quantity of a stop band in relation to a frequency response 
of the pre-filter that satisfies the attenuation quantity of the stop band when the number of 
taps is fixed and the band setting is changeable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, wherein this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has an 
arbitrary number of taps, and whose transfer function H (z) is related to a transfer 
function Z (z) of a pre-filter, wherein the filter coefficient is set in such a way as to 
execute a weighted approximation to the desired characteristics so as to satisfy an 
attenuation quantity of a stop band in relation to a frequency response of the pre-filter 
which satisfies an attenuation quantity of a stop band, when the number of taps is variable 
and band setting is changeable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, in which this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has arbitrary 
number of taps, and whose transfer function H (z) is related to a transfer function Z (z) of 
a pre-filter and a transfer function K (z) of an equalizer, wherein the filter coefficient is 
set on the basis of an amplitude characteristic of the equalizer obtained in such a way as 
to execute a weighted approximation to the desired characteristics so as to satisfy an 
attenuation quantity of a stop band in relation to a frequency response of the pre-filter 
which satisfies an attenuation quantity of a stop band, when the number of taps is variable 
and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FER filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FIR filter has arbitrary number of taps, and whose transfer function H (z) is 
related to a transfer function Z (z) of a pre-filter, wherein the filter coefficient is 
calculated by performing a weighted approximation to the desired characteristics so as to 
satisfy an attenuation quantity of a stop band in relation to the frequency response of the 
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pre-filter which satisfies an attenuation quantity of the stop band, when the number of 
taps is variable and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FIR filter has an arbitrary number of taps, and whose transfer function H 
(z) is related to a transfer function Z (z) of a pre-filter and a transfer function K (z) of an 
equalizer, wherein the filter coefficient is calculated depending on an amplitude 
characteristic of the equalizer obtained in such a way as to execute a weighted 
approximation to the desired characteristics so as to satisfy an attenuation quantity of a 
stop band in relation to the frequency response of the pre-filter which satisfies an 
attenuation quantity of the stop band, when the number of taps is variable and band 
setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, and the FIR filter's number of taps is variable, and whose band setting is 
changeable, the setting method of a filter coefficient of an FIR filter comprises the steps 
of: a first step for generating an interpolation polynomial equation for interpolating an 
amplitude characteristic from an extreme value point of the amplitude characteristic of 
the frequency; a second step for determining a new extreme value point from the 
amplitude characteristic obtained from the interpolation polynomial equation that is 
obtained in the first step; a third step forjudging whether or not a position of the extreme 
value is approximated within a required range while repeating the first step and the 
second step; a fourth step for examining an attenuation quantity of a stop band from the 
approximated amplitude characteristic obtained in the third step; a fifth step for 
comparing the examined attenuation quantity with the attenuation quantity of the stop 
band thus designated to judge whether or not a result of the comparison satisfies a 
predetermined condition; a sixth step for changing the band setting when a result of the 
comparison of the fifth step does not satisfy the predetermined condition; a seventh step 
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forjudging whether or not the present number of taps are capable of satisfying the 
attenuation quantity of the stop band after changing of the band in the sixth step; an 
eighth step for changing the number of taps when a judgement is performed that the 
present number of taps do not satisfy the attenuation quantity of the stop band in the 
seventh step; and a ninth step for finding the filter coefficient from the amplitude 
characteristic thus approximated depending on the third step which satisfies the 
predetermined condition in the fifth step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, wherein there is provided at least an initial setting step for carrying 
out setting of the FER filter, setting of the band, setting of coefficients of a pre-filter, and 
setting of an initial extreme value point, before executing the first step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, in the fourth step, in which the minimum attenuation quantity in the 
stop band is examined, and in the eighth step, the number of the taps is increased. 

Also, a method of setting filter coefficients of an FER filter of the present 
invention has a way, in the above described ninth step, wherein the filter coefficient is 
calculated by performing a weighted approximation with reference to the desired 
characteristics so as to satisfy an attenuation quantity of a stop band in relation to a 
frequency response of the pre-filter that satisfies the attenuation quantity of the stop band 
when the number of taps is variable and band setting is changeable. 

Also, a method of setting filter coefficients of an FER filter of the present 
invention has a way, in the above described ninth step, in which the filter coefficient is 
calculated depending on an amplitude characteristic of an equalizer obtained in such a 
way as to execute a weighted approximation with reference to the desired characteristics 
so as to satisfy an attenuation quantity of a stop band in relation to a frequency response 
of the pre-filter that satisfies the attenuation quantity of the stop band when the number of 
taps is variable and the band setting is changeable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, wherein this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FER filter has arbitrary 
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number of taps, and whose transfer function H (z) is related to a transfer function Z (z) of 
a pre- filter, wherein the filter coefficient is set in such a way as to execute a weighted 
approximation to the desired characteristics so as to satisfy an attenuation quantity of a 
stop band in relation to a frequency response of the pre- filter through which the 
attenuation quantity of the designated frequency of a transition band is passed, and which 
satisfies an attenuation quantity of a stop band, when the number of taps is made fixed 
and a band setting is changeable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, so that this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has arbitrary 
number of taps, and whose transfer function H (z) is related to a transfer function Z (z) of 
a pre- filter and a transfer function K (z) of an equalizer, wherein the filter coefficient is 
set on the basis of an amplitude characteristic of the equalizer obtained in such a way as 
to execute a weighted approximation to the desired characteristics so as to satisfy an 
attenuation quantity of a stop band in relation to a frequency response of the pre-filter 
through which the attenuation quantity of the designated frequency of a transition band is 
passed, and which satisfies an attenuation quantity of a stop band, when the number of 
taps is fixed and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
finite time length, in which this impulse response is equivalent to a filter coefficient of 
the FIR filter, the FIR filter has an arbitrary number of taps, and whose transfer function 
H (z) is related to a transfer function Z (z) of a pre-filter, wherein the filter coefficient is 
calculated by performing a weighted approximation to the desired characteristics so as to 
satisfy an attenuation quantity of a stop band in relation to the frequency response of the 
pre-filter through which an attenuation quantity of the designated frequency of a stop 
band is passed, and which satisfies an attenuation quantity of the stop band, when the 
number of taps is fixed and band setting is changeable. 

Also, a method of setting filter coefficients of an FER filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
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finite time length, in which this impulse response is equivalent to a filter coefficient of 
the FIR filter, the FIR filter has an arbitrary number of taps, and whose transfer function 
H (z) is related to a transfer function Z (z) of a pre-filter and a transfer function K (z) of 
an equalizer, wherein the filter coefficient is calculated depending on an amplitude 
characteristic of the equalizer obtained in such a way as to execute a weighted 
approximation to the desired characteristics so as to satisfy an attenuation quantity of a 
stop band in relation to the frequency response of the pre-filter through which an 
attenuation quantity of the designated frequency of a stop band is passed, and which 
satisfies an attenuation quantity of the stop band, when the number of taps is fixed and 
band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
finite time length, so that this impulse response is equivalent to a filter coefficient of the 
FIR filter, and the FIR filter's number of taps is fixed, and whose band setting is 
changeable, the setting method of a filter coefficient of an FIR filter comprises the steps 
of: a first step for generating an interpolation polynomial equation for interpolating an 
amplitude characteristic from an extreme value point of the amplitude characteristic of 
the frequency; a second step for determining a new extreme value point from the 
amplitude characteristic obtained from the interpolation polynomial equation that is 
obtained in the first step; a third step forjudging whether or not a position of the extreme 
value is approximated within a required range while repeating the first step and the 
second step; a fourth step for examining an attenuation quantity of a stop band from the 
approximated amplitude characteristic obtained in the third step; a fifth step for 
comparing the examined attenuation quantity in the fourth step with the attenuation 
quantity of the stop band thus designated to judge whether or not a result of the 
comparison satisfies a predetermined condition; a sixth step for changing the band setting 
when a result of the comparison of the fifth step does not satisfy the predetermined 
condition; a seventh step for examining an attenuation quantity of the designated 
frequency of the transition band which attenuation quantity satisfies a predetermined 
condition in the fifth step; an eighth step for comparing the attenuation quantity of the 
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designated frequency of the transition band that is examined in the seventh step with the 
attenuation quantity of the designated transition band, and forjudging whether or not a 
result of the comparison satisfies a predetermined condition; a ninth step for changing 
setting of the band when a result of the comparison of the seventh step does not satisfy 
the predetermined condition; and a tenth step for finding the filter coefficient from the 
amplitude characteristic thus approximated depending on the seventh step which 
amplitude characteristic satisfies the predetermined condition. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, wherein there is provided at least an initial setting step for carrying 
out setting of the FIR filter, setting of the band, setting of coefficient of a pre-filter, and 
setting of initial extreme value point, before executing the first step. 

Also, a method of setting filter coefficients of an FER filter of the present 
invention has a way, in the fourth step, wherein the minimum attenuation quantity in the 
stop band is examined. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, in the above described tenth step, wherein the filter coefficient is 
calculated by performing a weighted approximation with reference to the desired 
characteristics so as to satisfy an attenuation quantity of a stop band in relation to a 
frequency response of the pre-filter that satisfies the attenuation quantity of the stop band, 
and that causes the attenuation quantity of the designated frequency of the transition band 
to pass when the number of taps is fixed and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, in the above described tenth step, in which the filter coefficient is 
calculated depending on an amplitude characteristic of an equalizer obtained in such a 
way as to execute a weighted approximation with reference to the desired characteristics 
so as to satisfy an attenuation quantity of a stop band in relation to a frequency response 
of the pre-filter that satisfies the attenuation quantity of the stop band, and that causes the 
attenuation quantity of the designated frequency of the transition band to pass when the 
number of taps is fixed and the band setting is changeable. 
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Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, wherein this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has an 
arbitrary number of taps, and whose transfer function H (z) is related to a transfer 
function Z (z) of a pre-filter, wherein the filter coefficient is set in such a way as to 
execute a weighted approximation to the desired characteristics so as to satisfy an 
attenuation quantity of a stop band in relation to a frequency response of the pre-filter 
through which the attenuation quantity of the designated frequency of a transition band is 
passed, and which satisfies an attenuation quantity of a stop band, when the number of 
taps is variable and band setting is changeable. 

Also, an FIR filter of the present invention has a configuration in which the FIR 
filter's impulse response is expressed by using a finite time length, wherein this impulse 
response is equivalent to a filter coefficient of the FIR filter, the FIR filter has an 
arbitrary number of taps, and whose transfer function H (z) is related to a transfer 
function Z (z) of a pre-filter and transfer function K (z) of an equalizer, wherein the filter 
coefficient is set on the basis of an amplitude characteristic of the equalizer obtained in 
such a way as to execute a weighted approximation to the desired characteristics so as to 
satisfy an attenuation quantity of a stop band in relation to frequency response of the pre- 
filter through which the attenuation quantity of the designated frequency of a transition 
band is passed, and which satisfies attenuation quantity of a stop band, when the number 
of taps is variable and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FIR filter has an arbitrary number of taps, and whose transfer function H 
(z) is related to a transfer function Z (z) of a pre-filter, wherein the filter coefficient is 
calculated by performing a weighted approximation to the desired characteristics so as to 
satisfy an attenuation quantity of a stop band in relation to the frequency response of the 
pre-filter through which an attenuation quantity of the designated frequency of a stop 
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band is passed, and which satisfies an attenuation quantity of the stop band, when the 
number of taps is variable and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FIR filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FIR filter, the FIR filter has an arbitrary number of taps, and whose transfer function H 
(z) is related to a transfer function Z (z) of a pre- filter and a transfer function K (z) of an 
equalizer, wherein the filter coefficient is calculated depending on an amplitude 
characteristic of the equalizer obtained in such a way as to execute a weighted 
approximation to the desired characteristics so as to satisfy an attenuation quantity of a 
stop band in relation to the frequency response of the pre-filter through which an 
attenuation quantity of the designated frequency of a stop band is passed, and which 
satisfies an attenuation quantity of the stop band, when the number of taps is variable and 
the band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way in which the FER filter's impulse response is expressed by using a 
finite time length, wherein this impulse response is equivalent to a filter coefficient of the 
FER filter, and the FIR filter's number of taps is variable, and whose band setting is 
changeable, the setting method of a filter coefficient of an FIR filter comprises the steps 
of: a first step for generating an interpolation polynomial equation for interpolating an 
amplitude characteristic from an extreme value point of the amplitude characteristic of 
the frequency; a second step for determining a new extreme value point from the 
amplitude characteristic obtained from the interpolation polynomial equation that is 
obtained in the first step; a third step forjudging whether or not a position of the extreme 
value is approximated within required range while repeating the first step and the second 
step; a fourth step for examining an attenuation quantity of a stop band from the 
approximated amplitude characteristic obtained in the third step; a fifth step for 
comparing the examined attenuation quantity in the fourth step with the attenuation 
quantity of the stop band thus designated to judge whether or not a result of the 
comparison satisfies predetermined condition; a sixth step for changing the band setting 
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when result of the comparison of the fifth step does not satisfy the predetermined 
condition; a seventh step forjudging whether or not the present number of taps is capable 
of satisfying attenuation quantity of a stop band after changing of the band in the sixth 
step; an eighth step for changing the number of taps when judgement is performed that 
the present number of taps can not satisfy the attenuation quantity in the seventh step; a 
ninth step for examining a attenuation quantity of the designated frequency of the 
transition band which attenuation quantity satisfies a predetermined condition in the fifth 
step; a tenth step for comparing the attenuation quantity of the designated frequency of 
the transition band that is examined in the ninth step with the attenuation quantity of the 
designated transition band, and forjudging whether or not a result of comparison satisfies 
a predetermined condition; an eleventh step for changing a setting of the band when a 
result of comparison of the tenth step does not satisfy the predetermined condition; a 
twelfth step forjudging whether or not the present number of taps causes the signal to 
pass the designated frequency of the stop band after changing the band in the eleventh 
step; a thirteenth step for changing the number of taps when a judgement is performed 
that the present number of taps does not enable the designated frequency to be passed in 
the twelfth step; and a fourteenth step for finding the filter coefficient from the amplitude 
characteristic thus approximated depending on the tenth step which are amplitude 
characteristic satisfies the predetermined condition. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, wherein there is provided at least an initial setting step for carrying 
out the setting of the FIR filter, setting of the band, setting of coefficient of a pre-filter, 
and setting of initial extreme value point, before executing the first step. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way, in the fourth step, wherein the minimum attenuation quantity in the 
stop band is examined, and both in the eighth step and in the thirteenth step, the number 
of the taps is increased. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way wherein, in the above described fourteenth step, the filter coefficient 
is calculated by performing a weighted approximation with reference to the desired 
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characteristics so as to satisfy an attenuation quantity of a stop band in relation to 
frequency response of the pre-filter that satisfies the attenuation quantity of the stop band, 
and that causes the attenuation quantity of the designated frequency of the transition band 
to pass when the number of taps is variable and band setting is changeable. 

Also, a method of setting filter coefficients of an FIR filter of the present 
invention has a way wherein, in the above described fourteenth step, the filter coefficient 
is calculated depending on an amplitude characteristic of an equalizer obtained in such a 
way as to execute a weighted approximation with reference to the desired characteristics 
so as to satisfy an attenuation quantity of a stop band in relation to a frequency response 
of the pre-filter that satisfies the attenuation quantity of the stop band, and that causes the 
attenuation quantity of the designated frequency of the transition band to pass when the 
number of taps is variable and the band setting is changeable. 

According to the present invention, for instance, depending on the initial setting, 
the setting of the linear-phase FIR filter, the setting of the band, the setting of the 
coefficient of the pre-filter, and the setting of the extreme-value point are carried out. 

Subsequently, an interpolation polynomial equation is generated for interpolating 
an amplitude characteristic from the present extreme value point of the amplitude 
characteristic of the frequency. 

Next, a new extreme value point is determined from the amplitude characteristic 
obtained from the interpolation polynomial equation that is obtained in the first step. 

Judgement is performed whether or not a position of the extreme value is 
approximated within a required range while repeating the first step and the second step. 

Then, finding of the filter coefficient is performed from the approximated 
amplitude characteristic obtained. 

Thus, the FIR filter, whose coefficient is set, is capable of possessing the 
weighted approximation error with equi-ripple, further in which gain of the pass band is 
maintained constant value. 

BRIEF DESCRIPTION OF THE DRAWINGS 
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These and other objects and features of the present invention will become clearer 
from the following description of the preferred embodiments with reference to the 
accompanying drawings, in which: 

Fig. 1 is a view illustrating a transversal type circuit configuration of an FIR filter; 

Figs.2A to 2C are views illustrating one example of frequency response and 
weighted approximation error in order to avoid the chessboard distortion in the 
conventional method; 

Figs. 3 A to 3D are views illustrating an impulse response of four cases where the 
FIR filter possesses a linear-phase; 

Fig.4 is a view illustrating QCe 1 * 0 ) and R for four cases of the linear-phase FIR 

filter; 

Fig.5 is a view illustrating an example of a weighted Chebyshev approximation; 

Fig.6 is a flowchart of the Remez Exchange algorithms while taking into account 
a frequency response of the pre-filter according to the present invention; 

Figs.7A to 7C are views for explaining a determining method of a new extreme 
value of the weighted approximation error E(e iu) ); 

Fig. 8 is a view illustrating a frequency response of a low-pass filter which avoids 
the chessboard distortion designed according to the present invention; 

Figs. 9 A and 9B are views for comparing the frequency response of the low-pass 
filter designed by the conventional technique with the present invention respectively; 

Fig. 10 is a view illustrating a weighted approximation error for the filter designed 
according to the present invention; 

Fig. 1 1 is a view illustrating a flowchart of algorithms for finding a filter which 
satisfies an attenuation quantity of the stop band; 

Fig. 12 is a view illustrating a parameter in the algorithms for finding a filter that 
satisfies the attenuation quantity of the stop band and has the maximum end frequency of 
the pass band; 

Fig. 13 is a view illustrating an initial frequency of the dichotomizing method in 
the algorithms for finding a filter having the maximum end frequency of the pass band 
which filter satisfies the attenuation quantity of the stop band; 
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Figs.l4A to 14C are views illustrating a change of band setting in a loop of the 
first time; 

Figs.lSA and 15B are views illustrating a change of band setting in a loop after 
the second time and later; 

Fig. 16 is a view illustrating a frequency response of the filter having the 
maximum end frequency of pass band which filter satisfies an attenuation quantity of the 
stop band; 

Fig. 17 is a view illustrating a parameter in the algorithms for finding filter having 
the minimum starting frequency of the stop band which a filter satisfies an attenuation 
quantity of the stop band; 

Fig. 18 is a view illustrating an initial frequency of the dichotomizing method in 
the algorithms for finding a filter having the minimum starting frequency of the pass band 
which filter satisfies the attenuation quantity of the stop band; 

Figs.l9A to 19C are views illustrating a change of band setting in a loop of the 
first time; 

Figs.20A and 20B are views illustrating a change of band setting in a loop after 
the second time and later; 

Fig.21 is a view illustrating a frequency response of the filter having the minimum 
starting frequency of a stop band which filter satisfies an attenuation quantity of the stop 
band; 

Fig.22 is a view illustrating a flowchart of the algorithms for finding a filter with 
the minimum number of taps that satisfies an attenuation quantity of the stop band; 

Fig.23 is a view illustrating a frequency response of the filter with the minimum 
number of taps that satisfies an attenuation quantity of the stop band; 

Fig.24 is a view illustrating a flowchart of the algorithms for finding a filter that 
satisfies the attenuation quantity of the stop band and that enables the signal to be passed 
through the frequency point of the transition band; 

Fig.25 is a view illustrating algorithms (1) for finding a filter that satisfies the 
attenuation quantity of the stop band and that enables the signal to be passed through the 
frequency point of the transition band; 
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Fig.26 is a view illustrating an initial frequency of the dichotomizing method in 
the algorithms for finding a filter that satisfies the attenuation quantity of the stop band 
and that enables the signal to be passed through the frequency point of the transition 
band; 

Figs.27A to 29C are views illustrating a change of band setting in a loop of the 
first time; 

Figs.28A and 28B are views illustrating a change of band setting in a loop after 
the second time and later; 

Fig.29 is a view illustrating a frequency response (1) of the filter that satisfies the 
attenuation quantity of the stop band and that enables the signal to be passed through the 
frequency point of the transition band; 

Fig. 30 is a view illustrating algorithms (2) for finding a filter that satisfies the 
attenuation quantity of the stop band and that enables the signal to be passed through the 
frequency point of the transition band; 

Fig.31 is a view illustrating an initial frequency of the dichotomizing method in 
the algorithms for finding a filter that satisfies the attenuation quantity of the stop band 
and that enables the signal to be passed through the frequency point of the transition 
band; 

Figs.32A to 32C are views illustrating a change of band setting in a loop of the 
first time; 

Figs.33A and 33B are views illustrating a change of band setting in a loop after 
the second time and later; 

Fig.34 is a view illustrating a frequency response (2) of the filter that satisfies the 
attenuation quantity of the stop band and that enables the signal to be passed through the 
frequency point of the transition band; 

Fig.35 is a view illustrating a flowchart of the algorithms for finding a filter with 
the minimum number of taps that satisfies an attenuation quantity of the stop band; 

Fig.36 is a view illustrating a frequency response of the filter with the minimum 
number of taps that satisfies an attenuation quantity of the stop band; 
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Fig. 3 7 is a view illustrating a frequency response of the filter with the minimum 
number of taps that satisfies an attenuation quantity of the stop band; 

Fig.38 is a view illustrating a flowchart of the algorithms for finding a filter with 
the minimum number of taps that satisfies the attenuation quantity of the stop band and 
that enables the signal to be passed through the frequency band of the transition band; 
and 

Fig. 39 is a diagram illustrating a frequency response of the filter with the 
minimum number of taps which filter satisfies the attenuation quantity of the stop band, 
and which filter enables the signal to be passed through the frequency point of the 
transition band. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Below, preferred embodiments will be described with reference to the 
accompanying drawings. 

Preferred embodiments of the present invention will be explained with reference 
to the accompanying drawings below. 

A linear-phase FIR filter according to the present invention is capable of 
equivalently adopting transversal type circuit configuration as illustrated in Fig. 1 . The 
FIR filter includes nj_ series-connected unit time delay elements 2-1 to 2-n-l, n 
multipliers 3-1 to 3-n having filter coefficients h(0) to h(n-l), where (n-1) multipliers 3-1 
to 3 -n-1 are connected to input terminals of the corresponding unit time delay elements 2- 
1 to 2-n-l and a n-th multiplier 3-n is connected to an output terminal of n-th unit time 
delay element 2-n-l, and an adder 4 connected to output terminals of the n multipliers 3-1 
to 3-n. However, filter coefficients h, as described later in detail, can be obtained in such 
a way wherein the Remez Exchange algorithm is extended, and the desired amplitude 
characteristic is subjected to a Chebyshev approximation taking into account a frequency 
response of a pre-filter, and the filter coefficients h are obtained from the approximated 
amplitude characteristics. 
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Below, a concrete method for setting coefficients of the linear-phase FIR filter 
according to the present invention will be explained successively with reference to the 
drawings. 

In equation (3), the transfer function H (z) of the linear-phase FIR filter having N- 
taps is defined as a filter which calculates the product of the transfer function Z (z) of the 
pre-filter and the transfer function of the equalizer. 



Here, the pre-filter is a U tap of the linear-phase FIR filter, and the equalizer is a 
N - (U - 1) tap linear-phase FIR filter respectively. The transfer function of the pre- filter 
was previously given. 

A design of a filter of the transfer function H (z) is the determination of the 
transfer function K (z) of the equalizer having N - (U - 1) taps such that the amplitude 
characteristic H (e^) taps approaches to the desired amplitude characteristic D (e 310 ). 

In the present embodiment, in order to design the transfer function H (z) under 
consideration of the amplitude characteristic K (e^) of such pre-filter, a method si 
adopted in which the Remez Exchange algorithm is extended for solving a Chebyshev 
approximation problem. 

The number of taps allocated to the equalizer of the transfer function K (z) is 
defined asL = N-(U- 1). 

The transfer function K (z) of the linear-phase FIR filter, as illustrated in Figs. 3 A 
to 3D, is categorized with four cases because the transfer function thereof has a linear- 
phase. 

Concretely, it is categorized into four cases in which case 1; is a odd number of 
taps, and even symmetry as illustrated in Fig.3A; case 2 is an even number of taps, and 
even symmetry as illustrated in Fig.3B; case 3; is an odd number of taps, and odd 



H(z ) = Z(z) • K(z) 



•"(3) 
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symmetry as illustrated in Fig.3C; and case 4 is an even number of taps, and odd 
symmetry. 

With reference to the case 1, the amplitude characteristic function K (e ilu ) is left as 
it is, and for the other cases 2 to 4, is rewritten as follows. 



Case 1 : 




(4-1) 



CclS€5 2 * 



Case 3 : 



Case 4 : 




(4-2) 



(4-3) 



(4-4) 



Namely, the amplitude characteristic function K (d 10 ) is expressed by the product 
of the function Q (d 10 ) of the fixed parameters as illustrated in Fig.4 and a cosine series P 
(e ,(U ) including the design parameters. Hereinafter, the upper limit of a sum of the 
respective equations (4-1) to (4-4) is expressed as R - 1. Namely, R is calculated as 
shown in Fig.4. 

Further, a(n} t b(n} t c(n} d(n^ are expressed generally as P (n). 
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When the desired amplitude characteristic is taken to be D (d™), and the weight to 
respective frequencies is taken to be W (e^), the weighted approximation error is defined 
as follows: 

/^)-K^)•2(^)-^)•/ 3 (^)•2(s> , ) (6) 

Substituting equation (6) into equation (5), the following equation is obtained. 

l^)-^^^)-!^*)) (7) 

However, J^ 7 '"} ^{ e ' ) are expressed as follows: 



The equation (7) expresses the weighted approximation error of the linear-phase 
FIR filter in the four cases of case 1 to case 4. \ 

The weighted Chebyshev approximation problem is to determine a(n\ b(n\ c(n\ d{n) \ 
of the equations (4-1) to (4-4) that to brings the maximum value of |/s(i? yfl ' j 

within a designated frequency band into a minimum, in the equation (5). 

Hereinafter, these will be explained in relation to the concrete example. 

Here, the amplitude characteristic D (e^) is defined as illustrated in Fig.5 and the 
following. 



27 



80001-2117 
CLEAN VERSION 



Attorney Docket No. : SON-2 1 1 7 
Application No.: 09/874,061 



(error within i6 u 0<o«*> p ) 

i 

/j(e^)«0 terror within ±6 2 ,o,<o<n) (10) 

Note, when R is given, values of Oi, O2 cannot be designated arbitrarily, but it is 
possible to designate its ratio. 

The W (e^) is taken to be a constant value Wl in the pass band, and to be W2 in 
the stop band, thus being selected in such a way that Wl C\ = W2 O2 stands. For instance, 
Wl = 1, W2 = <5\ I O2 are made to select. At this time, next a alternating theorem stands. 

Theorem 

The necessary and sufficient condition in order that the cosine series P (e 1 ®) of (R 
- 1) order is the best weighted Chebyshev approximation to the target characteristic 
within the section (0, n) of co is as follows: 

(1) E (e* 03 ) obtains the extreme value at least (R + 1) times within the section (0, 
n). At this time, a frequency within which the extreme value is obtained is taken to be co 0 
<col<co2<..<co (R-l) < co R. 

(2) The signs of the neighboring extreme values are different, and the absolute 
values of the whole extreme values are the same. Namely, the following conditions are 
satisfied. 

d^y^Y* (i „ 0 , t, - , *~ « 

(i - 0,1, R.- 1) (ID 

Consequently, Jf^e^' | is equal to the maximum value of within 
the section. 

There are known Remez Exchange algorithms on the basis of the alternating 
theorem as the technique for obtaining the best Chebyshev approximation (Rabiner, L.R., 
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McClellan, J.H. and Parks, T.W.: "FIR Digital Filter Design Techniques Using Weighted 
Chebyshev Approximation", Proc. IEEE, Vol 63, April, pp.595-610, 1975). 

The Remez Exchange algorithms are algorithms in which the desired amplitude 
characteristic is carried out as a Chebyshev approximation within a frequency domain, 
and coefficients of the linear-phase FIR filter are obtained from the resultant 
approximated amplitude characteristic. 

Fig.6 is a flowchart of the Remez Exchange algorithms while taking into account 
a frequency response of the pre-filter according to the present invention. 

The Remez Exchange algorithm while taking into account the concrete frequency 
response of the pre-filter are as follows: 

StepO 

As illustrated in Fig.6, firstly, an initial setting is executed (F 101). In this initial 
setting, setting of the linear-phase FIR filter, setting of a band, setting of a coefficient of 
the pre-filter, and setting of an initial extreme point are carried out. 

Items set concretely are as follows: 

• the number of taps, 

• even symmetry or odd symmetry of the linear-phase FIR filter, 

• the number of the band, 

• the frequency of both ends of the respective bands, 

• the desired amplitude value of the respective bands, 

• weighting to the respective bands, 

• coefficient of the pre-filter, 

■ the frequency co (0) = C0k (0) (k = 0, .. , R) that becomes the extreme value in the 
approximation band. 

Note, the letter of a right shoulder (i) expresses the number of repetition. 
Step 1 

Next, LaGrange's interpolation polynomial equation is generated for interpolating 
an amplitude characteristic from the current extreme value point (F 102). 

Above equation (5) indicates the target function of the Chebyshev approximation. 
The necessary and sufficient condition for obtaining the minimum value of the target 
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function of the Chebyshev approximation is indicated by the alternating theorem. 
Accordingly, parameter p (n) of the following equation is found in such a way that, on the 
basis of the alternating theorem, the weighted approximation error 5 (l) from the desired 
amplitude characteristic at the respective frequency points are equal, and sign is 
alternated. 

Namely, the weighted approximation error of the equation (7) at the frequency 
points co (1) = o»k (1) (k = 0, .. , R) satisfies the following equation. 

4'*|^')-4'" f ")M-'^" i (*-«*..,«) (is) 

Hereinafter, the right shoulder letter (i) is omitted for simplification. The equation 
is carried as follows. 




Matrix expression of the equation (14) is as follows: 
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! cos(«> u ) cos(2<y„) 
s{«j,) cos(2w t ) 



cost 



cos^ - l)w 0 ) 



cosj 



1 



-1 



(- 1) 



W 



Mo) 

?(/?-!) 
3 



(-0 



(IS) 



However, since there are large amounts of calculation for calculating this equation 
(15), accordingly, 5 is analytically found firstly. 




<16) 



(17) 



f«4 



X j scoif^) (18) 

This oik is a surplus factor of a component of k-column (R + l)-row of the matrix 
F. Note, l^e""") and b[e jl0 \ ufce the equation (8) and the equation (9). 
Next, the following-equation is.provided by using 5. 
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In order to find the amplitude characteristic of the frequency except for the 
extreme value point, the LaGrange's interpolation polynomial expression is used as an 
interpolation polynomial expression for interpolating using the extreme value point. 
Namely, jP(e ;aJ ) * s calculated in such a way that the interpolation is executed so as 
to obtain value Ck at ©k (k=0, . . . , R-l) by using the LaGrange's interpolation polynomial 
expression. 




(20) 



(21) 



This result means the answer of the equation (15), and satisfies the equation (13) 
automatically at the point of cor. 
Step 2 

The new extreme value point is determined from the amplitude characteristic 
obtained from the interpolation polynomial expression (F 103), before returning to 
processing of F 102. Judgement is executed repeatedly whether or not the optimum 
approximation is obtained after the position of the extreme value is not changed (F 104). 

As above described, each extreme value point cok as a result of Step 1 is not 
necessarily the extreme value of the weighted function E (e^); in some cases, the point 
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which becomes | E (e j<B )|><5p ) exists. Thus, the new extreme value co (f+1) is determined 
from the all point simultaneous replacement method. 
All Point Simultaneous Replacement Method 

On the basis of the following equation, the extreme value of weighted 
approximation error calculated from the extreme value used for the interpolation is 
searched over the whole approximation bands, and the searched extreme values are taken 
to be the new extreme values co = ©k (k = 0, 1, . . . , R), thus returning to Step 
1. 

4^)^ (23> 

It is decided that when the position of the extreme value has not been changed, the 
optimum approximation is obtained. This is the condition of the termination of the 
repetition so that when the condition is satisfied, processing advances to next Step 3. 

Figs.7A to 7C are conceptual views of the all point replacement method. 

Explanation is made simply. The black dots in Figs. 7 A to 7C express the extreme 
value points used for the interpolation. The weighted approximation error 
E (d®) obtained from the extreme value points corresponds to the solid line. 

As illustrated in Fig.7A, values of the weighted approximation error at the 
extreme value points of the black dots become open circles. However, the actual extreme 
values are frequency indicated by black squares. Accordingly, the frequency indicated by 
the black squares is taken to be the new extreme value point, then returning to processing 
of Step 1. 

Further, as illustrated in Fig.7B, since a deviation of the frequency exists between 
the extreme value points used for the interpolation and the actual extreme value, the 
frequency indicated by the square is taken to be the new extreme value point, then 
returning to processing of Step 1 . 

Then, as illustrated in Fig.7C, when the extreme value points used for the 
interpolation and the extreme value point (open circles) of the actual weighted 
approximation error becomes the same, the repetition processing terminates. 
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Step 3 

Coefficients of the linear-phase FIR filter are found from the approximated 
amplitude characteristic (F 105). 

When n-tap of impulse response h (n) is found from the optimum approximation 
function P (e ico ), the n-tap of impulse response is obtained from the following equation 
instead of P (n). 

t^)-Fte"yde*)*& m ) (24) 

Case 1 : 




34 



80001-2117 
CLEAN VERSION 



Attorney Docket No. : SON-2 1 1 7 
Application No.: 09/874,061 



Further, when the impulse response k (n) of the equalizer of L = N - (U - 1) tap is 
found, the following equation is calculated. 



4 > ^4 > ') # o(^) 



(29) 



Case 1: 



(30) 



Case 2: 



*4!HtH))^-5)K) 



(31) 



Case 3: 



(32) 



Case 4: 



* w -i|-^(f(*4)Mfh*4) 



<33) 
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As to the pre-filter, when the transfer function Z (n) is 1 as indicated in the 
following equation, the Remez Exchange algorithm in question is substantially equal to a 
normal Remez Exchange algorithm. 



Here, comparison between the conventional technique and the method of the 
present invention is carried out by taking a zero point for avoiding the Chessboard 
distortion to be the pre-filter. 

The frequency response of the pre-filter is expressed as follows: 



The specification of the conventional technique and the present invention are 
indicated below. 

Fig.8 is a view illustrating a frequency response of a low-pass filter which avoids 
the chessboard distortion designed depending on the present invention. Figs.9A and 9B 
are views for comparing the frequency response of the low-pass filter designed depending 
on the conventional technique with the present invention respectively. Fig. 10 is a view 
illustrating a weighted approximation error to the filter designed depending on the present 
invention. 

Specification of the conventional technique 
Linear-phase FIR filter of equalizer 

• 22 taps 

• even symmetry 




(34) 
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Method of Design 

The equalizer is made to design with the Remez Exchange algorithms; thus the 
pre- filter of zero point is folded into the linear-phase FIR filter in order to avoid the 
chessboard distortion of U = 3. Finally, the linear-phase FIR filter with 24 taps is 
designed. 

[Table 1] 

Band 



Band 


Range of frequency 


gain 


weight 


1 


0<co^0.3n 


1 


1 


2 


0. 5n<co<n 


0 


1 



In Figs.9A and 9B, the conventional technique is illustrated by dotted line written 
as "Conventional". 

Specification of the present invention 
Linear-phase FIR filter 

* 24 taps 

* even symmetry 

* U = 3 
Method of Design 

Designing has been attempted with Remez Exchange algorithms by taking into 
account the frequency response of the pre-filter of zero point for avoiding the chessboard 
distortion. 



[Table 2] 

Band 



Band 


Range of frequency 


gain 


weight 


1 


0<u^0.3n 


1 


1 


2 


0 . 5n^oo^n 


0 


1 
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The dotted lines in Fig. 8 and Figs. 9 A and 9B indicate the frequency 
characteristic of the pre- filter and the frequency characteristics of the equalizer of the 
zero point for avoiding the chessboard distortion. The solid lines indicate both the 
frequency characteristic (Proposed H (z)) obtained finally and the frequency (Zero Point) 
that must be H (z) = 0 for avoiding the chessboard distortion. 

As seen from Fig.8 to Fig. 10, the method of the present invention is capable of 
obtaining good frequency response characteristic compared with the conventional 
technique. 

Next, as a modified example, an algorithm which satisfies an attenuation quantity 
of the designated stop band will be explained. 

This algorithm is an algorithm satisfies the attenuation quantity (weighted 
approximation error) of the designated stop band in connection with the low-pass filter 
with 2 numbers of bands or the high-pass filter by using the Remez Exchange algorithms 
which take into account the frequency response of the pre-filter. 

Further, in later explanation, description is made for the low-pass filter, however, 
when the algorithm is intended to apply to the high-pass filter, the pass-band and the 
block-band are inversely related. 

As a method for satisfying an attenuation quantity of the stop band, there exists 
three kinds of approaches. 

The first approach is that the end frequency cop of the pass band is made variable, 
the starting frequency cos of the stop band is made to be fixed, and the number of taps is 
made to be fixed. 

The second approach is that the end frequency cop of the pass band is made to be 
fixed, the starting frequency cos of the stop band is made variable, and the number of taps 
is made to be fixed. 

The third approach is that the end frequency cop of the pass band is made to be 
fixed, the starting frequency cos of the stop band is made to be fixed, and the number of 
taps is made variable. 
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The first, the second, and the third approaches are explained below with reference 
to the accompanying drawings successively. 
First Approach 

In the first approach, the maximum end frequency cop of the pass band that 
satisfies the attenuation quantity dBs of the designated stop band is found. 

Fig.l 1 is a view illustrating a flowchart of algorithms for finding a filter that 
satisfies the attenuation quantity of the stop band. 

Fig. 12 is a view illustrating a flowchart of algorithms for finding a filter that has 
the maximum end frequency of the pass band, which end frequency satisfies the 
attenuation quantity of the stop band, in which free parameters (variable) and fixed 
parameters (variable) are expressed. 

Here, free parameters in the algorithms, object, and the principle of the algorithms 
are enumerated as follows: 

* Free parameters: end frequency cop of the pass band. 

* Object: it is an object to obtain a filter that has the maximum end frequency cop 
of the pass band, which end frequency satisfies the attenuation quantity of the designated 
stop band. 

* Principle: the starting frequency of the pass band and the frequencies of both 
ends of the stop band are fixed, and the end frequency of the pass band is the free 
parameter. In the Chebyshev approximation according to the Remez Exchange 
algorithms, 

• the end frequency cop of the pass band moves far away rather than the starting 
frequency cos; 

— ► the attenuation quantity of the stop band becomes large; 

* the end frequency cop of the pass band approaches the starting frequency cos of 
the stop band 

— ► the attenuation quantity of the stop band becomes small. 
Namely, cop (cur) is made to prepare at the frequency (in the vicinity of co = 0) 
which is far from the starting frequency cos of the stop band. While, cop^ which is close 
to the starting frequency of the stop band is made to prepare as initial frequency. Then, 
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the position cop of the maximum end frequency is found within the pass band that 
satisfies the designated attenuation quantity while utilizing the dichotomizing method. 

Further, the golden section method is the most efficient method in the line search 
methods of such parameter. However, the dichotomizing (two branching) method is 
adopted here. The dichotomizing method has the algorithms which are easy to 
understand. 

Fig.l 1 and contents of each step processing F 102, F 103, F 104, F 105 of the 
algorithms described hereinafter are the same as the Remez Exchange algorithms when 
taking into account the frequency response of the pre-filter described in relation to Fig. 6. 
Accordingly, the same signs as that of Fig.6 are used in connection with these processing. 
Step 10 

As illustrated in Fig.l 1, firstly, initial setting is executed (F 201). In this initial 
setting, setting of the linear-phase FIR filter, setting of the band, setting of the coefficient 
of the pre-filter, setting of the initial extreme value point, designation of the attenuation 
quantity of the stop band, and setting of the initial frequency of the dichotomizing 
method are executed. 

Concrete items thus set are as follows: 

• the number of taps 

• linear-phase FER filter with even symmetry or odd symmetry 

• the number of the band is two 

• the starting frequency of the pass band 

• gain of the pass band 

• frequencies of both ends of the stop band 

• gain of the stop band 

• weighting in connection with the pass band and the stop band 

• coefficients of the pre-filter 

■ attenuation quantity dBs (namely, pointing largeness 52 of ripple of the stop 

band) 
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• frequency co ( } = gv } (k = 0, , R) that becomes the extreme value in the 
approximation band. Provided letter of right shoulder (i) expresses the number of 
repetition. 

Also, Fig. 13 is a view illustrating initial frequency of the dichotomizing method 
in the algorithms for finding a filter having the maximum end frequency of the pass band 
that satisfies the attenuation quantity of the stop band. 

As illustrated in Fig. 13, in the present example, the following values are given as 
the initial frequencies of the dichotomizing method. 

art)] 

= the vicinity of starting frequency of the stop band (37) 

p L - the vicinity of starting frequency of the pass band (38) 

Portion of [t] at the back of cop expresses the number of cycle. 

Here, the Remez Exchange algorithms taking into account the frequency response 
of the pre-filter are executed to the frequency Wp Pr ^[0 J , thus the minimum of the 
attenuation quantity in the stop band is found. The following steps are 

explained on the basis of the assumption. 
Step 11 

The Remez Exchange algorithm taking into account the frequency response of the 
pre-filter is executed (F 102, F 103, F 104). 

Concretely, in the processing F 102, the interpolation polynomial expression is 
generated for interpolating the amplitude characteristic from the extreme value point at 
the time of 0) c p ur [t], 

Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing F 104, the repetition judgement of the Remez Exchange 
algorithm is executed. 
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Step 12 

Next, the attenuation quantity of the stop band is examined (F 206). 

The minimum attenuation quantity (the maximum weighted approximation error 
52) dB^ ur ^t ] is examined in the stop band by using the interpolation polynomial 
expression founded in the processing F 102. 
Step 13 

Next, comparison is attempted in connection with the attenuation quantity of the 
designated stop band (F 207). 

Concretely, in the case that the result of the comparison satisfies the following 
equations (39) or (40) while comparing with the attenuation quantity dBs of the 
designated stop band, processing is moved to processing of Step 15 (F 105). While when 
the result of the comparison does not satisfy equations (39) or (40), processing is moved 
to processing of Step 14 (F 208). 

Provided that el and zl are extremely small values. 

Step 14 

Setting of the band is changed when the result of the comparison does not satisfy 
equations (39) or (40), in the comparison to the attenuation quantity dBs of the 
designated stop band (F 208). 

Concretely, the end frequency (Op Ur [t + l] of a new pass band is made to set. 
Explanation is made while dividing into two cases of the first loop and the second loop as 
the setting method. 

First time: 

In the case of the first time, there are three cases illustrated in Figs.l4A to 14C. 
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Namely, cases illustrated in Fig.l4A, Fig.l4B, and Fig.l4C are considered in 
connection with the frequencies wjf ' ^[o] ^''''[o] . 

The case illustrated in Fig.l4A is one in which both satisfy the designated 
attenuation quantity. In this case, the frequency ^f ,e ^oj close to the starting 
frequency cos of the stop band is taken to be a solution, thus advancing toward to the 
processing of Step 15. 

The case illustrated in Fig.l4B is one in which both do not satisfy the designated 
attenuation quantity. In this case, the present number of taps cannot realize the designated 
attenuation quantity. Accordingly, that effect is indicated to end processing. 

The case illustrated in Fig.l4C is one in which only one side satisfies the 
designated attenuation quantity. In this case, processing is moved to Step 1 1 in such a 
way as following equation (41). 

Further, in the present method for giving an initial frequency point, there is no 
case in which ^f'^[o] is satisfied and a^ c "''[o] is not satisfied. 



Second time and later: 

In the case of a second time and later, two cases indicated in Figs.lSA and 15B 
are considered. In the determining method of the new frequency in the second time and 
later, the frequency which satisfies the designated attenuation quantity dBs is preserved 
invariably within (wjf '^[f +l] • The case illustrated in Fig. 15 A, Fig. 15B is considered in 
connection with the frequencies co ^ Pre ^[f ] cj ^ ur ] . 

The case illustrated in Fig.lSA is one in which one side satisfies the designated 
attenuation quantity. In this case, the processing is moved to next step 11 in such a way 
as the following equation (42). 
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Further, since the frequency which satisfies the designated attenuation quantity 



always conforms to ar[" c \t\ , there does not exist the case that does not satisfy. 



c<rt + l]- a5x ^jrlf ] + (42 ) 



The case illustrated in Fig.lSB is one in which both satisfy the designated 
attenuation quantity. In this case, the processing is moved to next step 1 1 in such a way 
as the following equation (43). 



The coefficients of the linear-phase FIR filter are obtained from the approximated 
amplitude characteristic (F 105). 

Namely, the coefficients of the linear-phase FIR filter are obtained from the 
amplitude characteristic obtained finally. 

Fig. 16 is a view illustrating frequency response characteristic of the low-pass 
filter obtained from the algorithms for obtaining "filter having the maximum end 
frequency of the pass band that satisfies the attenuation quantity of the stop band" while 
taking the filter of the zero point for avoiding the chessboard distortion. 

Fundamental algorithms, variable intended to find, and band of this case are as 
follows: 

Fundamental algorithms 

It is the Remez Exchange algorithms taking into account a frequency 
characteristic of the pre- filter. 




(43) 



dB im) [t + l]=dB {eu,) [t] 



Step 15 



• 24 taps 
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• 24 taps 

• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 40 dB 
Variable intended to find 

It is the end frequency cop of the pass band. 



[Table 3] 

Band 



band 


Frequency region 


gain 


weight 


Pass band 


0<co<icdp 


1 


1 


Stop band 


0.5n^co<n 


0 


1 



Further, in Fig. 16, the solid line indicates frequency response of a low-pass filter 
that has the maximum end frequency of the pass band which satisfies the attenuation 

quantity of the stop band. Furthermore, the dotted line indicated by d> indicates 

frequency which becomes zero point for avoiding the chessboard distortion, and the 
dotted line indicated by © indicates a period of the band given beforehand. 

As seen from Fig. 16, the low-pass filter which is obtained from the algorithms for 
finding a "filter having the maximum end frequency of the pass band which satisfies the 
attenuation quantity of the stop band" according to the present invention has a good 
frequency response characteristic. 

Second approach 

Next, in the second approach, the minimum starting frequency cos of the stop band 
that satisfies the attenuation quantity dBs of the designated stop band is found. 

The flowchart for this attempt is equivalent to that of Fig. 1 1 referred to in the first 
approach. 
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Fig. 17 shows a free parameter (variable) and a fixed parameter (variable) in the 
algorithms for finding a filter having the minimum starting frequency of the stop band 
that satisfies the attenuation quantity of the stop band. 

Here, the free parameters of these algorithms, objects, and the principle of the 
algorithms thus enumerated are as follows: 

* free parameter: it is the starting frequency cos of the stop band. 

* objects: it is an object to obtain a filter having the minimum starting frequency 
cos of the stop band that satisfies an attenuation quantity of the designated stop band. 

* principle: the end frequency of the stop band and the frequencies of both ends of 
the pass band are fixed, and the starting frequency of the stop band is the free parameter. 
In the Chebyshev approximation according to the Remez Exchange algorithms, 

• the starting frequency cos of the stop band moves far away rather than the end 
frequency cop of the pass band — ► the attenuation quantity of the stop band becomes large. 

• the starting frequency cos of the stop band approaches the end frequency cop of 
the pass band — ► the attenuation quantity of the stop band becomes small. 

Namely, co s (pre) is made to prepare that is far from the end frequency of the pass 
band, while co s (eur) which is close to the end frequency of the pass band is made to prepare 
as initial frequencies. Then, a position cos of the minimum starting frequency is found 
within the stop band that satisfies the designated attenuation quantity while utilizing the 
dichotomizing method. 

Further, the golden section method is the most efficient method in the line search 
methods of such parameter. However, the dichotomizing method is adopted here. The 
dichotomizing method has the algorithms which are easy to understand. 

Also, Fig.l 1 and contents of each step processing F 102, F 103, F 104, F 105 of 
the algorithms described hereinafter are the same as the Remez Exchange algorithms 
while taking into account the frequency response of the pre-filter described in relation to 
Fig.6 in the same way as the case of the first approach. Accordingly, the same signs as 
that of Fig.6 are used in connection with these processing. 
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Step 20 



As illustrated in Fig.l 1, firstly, an initial setting is executed (F 201). In this initial 
setting, setting of the linear-phase FIR filter, setting of the band, setting of a coefficient of 
the pre-filter, setting of the initial extreme value point, designation of attenuation quantity 
of the stop band, and setting of initial frequency of dichotomizing method are executed. 

Concrete items thus set are as follows: 

• the number of taps 

• linear-phase FIR filter with even symmetry or odd symmetry 

• the number of the bands is two 

• the starting frequency of the pass band 

• gain of the pass band 

• frequencies of both ends of the stop band 

• gain of the stop band 

• weighting to the pass band and the stop band 

• coefficients of the pre-filter 

• attenuation quantity dBs (namely, pointing largeness 52 of ripple of the stop 

band) 

• frequency co (0) = cok (0) (k = 0, .. , R) that becomes the extreme value in the 
approximation band. The provided letter of right shoulder (i) expresses the number of 
repetition. 

Also, Fig. 18 is a view illustrating initial frequency of the dichotomizing method 
in the algorithms for finding a filter having the minimum starting frequency of the stop 
band that satisfies the attenuation quantity of the stop band. 

As illustrated in Fig. 18, in the present example, the following values are given as 
the initial frequencies of the dichotomizing method. 



the vicinity of end frequency of the pass band 



(44) 




the vicinity of end frequency of the stop band (45) 



A portion of [t] at the back of cos expresses the number of cycle. 
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Here, the Remez Exchange algorithms taking into account the frequency response 
of the pre- filter are executed to the frequency <^J P/ ^[o] , thus the minimum of the 
attenuation quantity a^ pr ^[o] in the stop band is found, £he following steps are 
explained on the basis of this assumption. 

Step 21 

The Remez Exchange algorithms taking into account the frequency response of 
the pre-filter are executed (F 102, F 103, F 104). 

Concretely, in the processing F 102, the interpolation polynomial expression is 
generated for interpolating an amplitude characteristic from the extreme value point at the 
timeof »M°J- 

Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing F 104, repetition judgement of the Remez Exchange 
algorithms is executed. 

Step 22 

Next, the attenuation quantity of the stop band is examined (F 206). 

The minimum attenuation quantity (the maximum weighted approximation error 
52) <yZ?j c ^[t] is examined in the stop band while using the interpolation polynomial 
expression founded in the processing F 102. 
Step 23 

Next, comparison to the attenuation quantity of the designated stop band is 
executed (F 207). 

Concretely, in the case that result of the comparison satisfies following equations 
(46) or (47) while comparing with the attenuation quantity dBs of the designated stop 
band, processing is moved to processing of Step 25 (F 105). While when result of the 
comparison does not satisfy equations (46) or (47), processing is moved to processing of 
Step 24 (F 208). 
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(46) 



K'-'M- ..•"Wife 



(47) 



Provided that el and zl are extremely small values. 

Step 24 

Setting of the band is changed when the result of the comparison does not satisfy 
equations (46) or (47), in the comparison to the attenuation quantity dBs of the 
designated stop band (F 208). 

Concretely, the starting frequency <wj cl "^[f +l] of a new stop band is made to 
set. Explanation is made while dividing into two cases of the first loop and the second 
loop as the setting method. 



In the case of the first time, there are three cases illustrated in Figs.l9A to 19C. 
Namelv. cases illustrated in Fig. 19 A, Fig.l9B, and Fig.l9C are considered to 



The case illustrated in Fig.l9A is one in which the both satisfy the designated 
attenuation quantity. In this case, the frequency co j pr ^[o] 

close to co=0 is taken to be solution, thus advancing toward to the processing of Step 25. 

The case illustrated in Fig. 1 9B is one in which the both do not satisfy the 
designated attenuation quantity. In this case, the present number of taps can not realize 
the designated attenuation quantity. Accordingly, that effect is indicated to end. 

The case illustrated in Fig.l9C is one in which only one side satisfies the 
designated attenuation quantity. In this case, processing is moved to Step 21 in such a 
way as in the following equation (48). 

Further; in the present method for giving an initial frequency point, the case in 
whichtoJ pre ^o|is satisfied and qj^ cu r \®\ is not satisfied does not exist. 



First time: 
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Second time and later: 

In the case of second time and later, two cases indicated in Figs.20A and 20B are 
considered. In the determining method of the new frequency in the second time and later, 
the frequency which satisfies the attenuation quantity dBs thus designated is preserved 
invariably within ttJj^jf +l] . The case illustrated in Fig.20A, Fig.20B is considered to 
the frequencies QJ^tl^H . - 

The case illustrated in Fig.20A is one in which one side satisfies the designated 
attenuation quantity. In this case, the processing is moved to next step 21 in such a way 
as the following equation (49). 

Further, since the frequency which satisfies the designated attenuation quantity 
always conforms to > the case that a^'^jf does not satisfy does not exist. 

£o!"" ) [/+l]-^ ) [f] 



The case illustrated in Fig.20B is one in which the both satisfies the designated 
attenuation quantity. In this case, the processing is moved to next step 21 in such a way 
as the following equation (50). 



50 



80001-2117 
CLEAN VERSION 



Attorney Docket No.: SON-2117 
Application No.: 09/874,061 



Step 25 

The coefficients of the linear-phase FIR filter are found from the approximated 
amplitude characteristic (F 105). 

Namely, the coefficients of the linear-phase FIR filter are found from the 
amplitude characteristic obtained finally. 

Fig.21 is a view illustrating a frequency response characteristic of the low-pass 
filter obtained from the algorithms for finding "filter having the minimum starting 
frequency of stop band which filter satisfies the attenuation quantity of the stop band" 
while taking the filter of the zero point for avoiding the chessboard distortion. 

Fundamental algorithms, variables intended to find, and band of this case are as 
follows: 

Fundamental algorithms 

It is the Remez Exchange algorithms taking into account frequency 
characteristic's of the pre-filter. 

• 24 taps 

• even symmetry 

• U = 3 (filter coefficient is executed U times such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 40 dB 
Variable intended to find 

It is the starting frequency ws of the stop band. 



[Table 4J 

Band 



band 


Frequency region 


gain 


weight 


Pass band 




1 


1 


Stop band 




0 


X 



Further, in Fig.21 , the solid line indicates a frequency response of a low-pass filter 
that has the minimum starting frequency of the stop band which satisfies the attenuation 
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quantity of the stop band. Furthermore, the dotted line indicated by <D indicates a 

frequency which becomes a zero point for avoiding the chessboard distortion, and the 
dotted line indicated by 0 indicates a period of the band given beforehand. 

As seen from Fig.21, the low-pass filter which is obtained from the algorithms for 
finding a "filter having the minimum starting frequency of the stop band which satisfies 
attenuation quantity of the stop band" according to the present invention has a good 
frequency response characteristic. 

Third approach 

Finally, in the third approach, the minimum number N of taps that satisfies the 
attenuation quantity dBs of the designated stop band is found. 

Fig.22 is a view illustrating a flowchart of the algorithms for finding a filter with 
the minimum number of tap that satisfies the attenuation quantity of the stop band. 

Here, free parameters of these algorithms, objects, and the principle of the 
algorithms thus enumerated are as follows: 

* free parameters: it is the number of taps 

* objects: it is an object to obtain a filter having the minimum number of taps that 
satisfies attenuation quantity of the designated stop band. 

* principle: since variable of the band is fixed, when it is impossible to satisfy the 
attenuation quantity of the designated stop band, the number of taps is increased by one 
tap. 

Also, Fig.22 and contents of each step processing F 102, F 103, F 104, F 105 of 
the algorithms described hereinafter are the same as the Remez Exchange algorithms 
while taking into account the frequency response of the pre-filter described in relation to 
Fig.6 in the same way as the case of the first approach. Further, contents of processing F 
206 is the same as the processing explained in relation to Fig.l 1 in the same way as the 
case of the second approach. Accordingly, the same signs as that of Fig.6 and Fig.l 1 are 
used in connection with these processing. 
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Step 30 

As illustrated in Fig.22, firstly, an initial setting is executed (F 401). In this initial 
setting, setting of linear-phase FIR filter, setting of band, setting of coefficient of the pre- 
filter, setting of the initial extreme value point, and designation of attenuation quantity of 
the stop band, are executed. 

Concrete items thus set are as follows: 

* the number of initial taps 

* linear-phase FIR filter with even symmetry or odd symmetry 

* the number of the band is two 

* the starting frequency and end frequency of respective bands 

* gain of respective bands 

* weighting of respective bands 

* coefficient of the pre-filter 

* attenuation quantity dBs (namely, pointing largeness 52 of ripple of the stop 

band) 

* frequency co (0) = co k (0) (k = 0, , R) that becomes the extreme value in the 
approximation band. Provided letter of right shoulder (i) expresses the number of 
repetition. 

Step 31 

The Remez Exchange algorithms taking into account the frequency response of 
the pre-filter are executed (F 102, F 103, F 104). 

Concretely, in the processing F 102, the interpolation polynomial expression is 
generated for interpolating an amplitude characteristic from the 
extreme value point at the time of oo p (cur) [ t ]. 

Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing step F 104, repetition judgement of the Remez Exchange 
algorithms is executed. 

Step 32 

Next, the attenuation quantity of the stop band is examined (F 206). 
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The minimum attenuation quantity (the maximum weighted approximation error 



is examined in the stop band while using the interpolation polynomial expression 
founded in the processing F 102. 
Step 33 

Next, comparison to the attenuation quantity of the designated stop band is 
executed (F412). 

Concretely, in the case that the result of the comparison satisfies the following 
equations (51) while comparing with the attenuation quantity dBs of the designated stop 
band, processing is moved to processing of Step 35 (F 105). When the result of the 
comparison does not satisfy equations (51), processing is moved to processing of Step 34 



Step 34 

One tap is increased (F 413). 

Namely, one tap is increased in addition to the present number of taps, thus 
processing is moved to processing of Step 31. 



The coefficients of the linear-phase FIR filter is found from the approximated 
amplitude characteristic (F 105). 

Namely, the coefficients of the linear-phase FIR filter is found from the amplitude 
characteristic obtained finally. 

Fig.23 is a view illustrating a frequency response characteristic of the low-pass 
filter obtained from the algorithms for finding "the minimum number of taps that satisfies 
attenuation quantity of the stop band" while taking the filter of the zero point for avoiding 
the chessboard distortion. 

Fundamental algorithms, variables intended to find, and band of this case are as 
follows: 



. 52)dB s (cur) [t] 



(F413). 




(51) 



Step 35 
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Fundamental algorithms 

It is the Remez Exchange algorithms taking into account frequency characteristic 
of the pre- filter. 

• the number of initial taps is 10 taps 

• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 60 dB 
Variables intended to find 

It is the number N of taps. 

[Table S3 



Band 



band 


Frequency region 


gain 


weight 


Pass band 
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1 


Stop band 


0,5n£u<;n 


0 


I 



Further, in Fig.23, the solid line indicates a frequency response of a low-pass filter 
of the minimum number of taps (36 taps) in which the attenuation quantity of the stop 
band becomes not more than -60 dB. Furthermore, the dotted line indicated by (D 
indicates frequency which becomes a zero point for avoiding the chessboard distortion, 
and the dotted line indicated by © indicates a period of the band given beforehand. 

As known from Fig.23, the low-pass filter which is obtained from the algorithms 
for finding "the minimum number of tap which realizes attenuation quantity of the stop 
band" according to the present invention has a good frequency response characteristic. 

Subsequently, as the second modified example, explanation is provided about 
algorithms for finding a filter that causes the signal to pass a frequency point of a 
transition band that satisfies an attenuation quantity of the stop band. 

Here, the following are free parameter in the algorithms, object, and the principle 
of the algorithms. 
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* Free parameter: end frequency cop of the pass band and starting frequency cos of 
the stop band. 

* Object: it is an object to determine a band that satisfies attenuation quantity dBs 
and makes attenuation quantity dBc with a frequency coc of a transition band pass 
through. Namely, it is an object to obtain the maximum end frequency cop of the pass 
band and the minimum starting frequency cos of the stop band by which the attenuation 
quantity dBc is realized with specific frequency coc of the transition band. 

* Principle: the starting frequency of the pass band and the end frequency of the 
stop band are fixed, and the end frequency op of the pass band and the starting frequency 
cos of the stop band are the free parameters. Since there are two free parameters, it is 
impossible to determine appropriately if moving simultaneously. Accordingly, one side 
of the parameter is fixed, while the other side of parameter that satisfies attenuation 
quantity of the stop band is found. When the band does not make the attenuation quantity 
dBc with the frequency coc of the transition band pass through, it causes the fixed 
parameter to be changed. The above repetition is carried out so that the band which 
makes the attenuation quantity dBc with the frequency coc of the transition band pass 
through is determined. 

In the method for finding a parameter that satisfies the attenuation quantity of the 
stop band, there are two kinds of approaches. 

Namely, the first approach is that a filter which has the minimum starting 
frequency of the stop band that satisfies the attenuation quantity of the stop band is found. 

The second approach is that a filter which has the maximum end frequency of the 
pass band that satisfies the attenuation quantity of the stop band is found. 

Algorithms on the basis of the above two kinds of approaches are explained 
successively. 

Fig.24 is a flowchart of algorithms for finding filter that satisfies the attenuation 
quantity of the stop band and that enables the signal to be passed through the frequency 
point of the transition band. 
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The algorithms on the basis of the filter having the minimum starting frequency of 
the stop band that satisfies the attenuation quantity of the stop band will be explained in 
relation to Fig.24 to Fig.29. 

Namely, the present algorithms utilize the algorithms for finding a "filter having 
the minimum starting frequency of the stop band that satisfies the attenuation quantity of 
the stop band". 

During the concrete course of the algorithms, as illustrated in Fig.25, cos is 
obtained with the aforementioned algorithms as an inner loop, and a further loop for 
finding cop is put on an outside thereof to determine parameter of the band. Namely, the 
outside loop causes the end frequency cop of the pass band to be fixed, while the inner 
loop causes the starting frequency cos of the stop band to be found that satisfies the 
attenuation quantity dBs of the stop band. 

When the amplitude characteristic thus found does not pass through the 
designated point (wc, dBc) of the transition band, cop is searched while using a 
dichotomizing method like the case of searching for a "filter having the maximum end 
frequency of the pass band that satisfies the attenuation quantity of the stop band". 

Hereinafter, concrete algorithms are indicated: however, since the algorithms for 
finding a "filter having the minimum starting frequency of the stop band that satisfies the 
attenuation quantity of the stop band" to be the inner loop is the same as that described 
above, thus description thereof is omitted. 

Also, the content of Fig.24 and each step processing F 102, F 103, F 104, and F 
105 of the algorithms explained below, like the case of the first approach, is the same as 
the Remez Exchange algorithms taking into account the frequency response of the pre- 
filter explained in relation to Fig.6. Further, the content of each processing F 206, F 207, 
F 208, like the case of the second approach, is the same as the processing explained in 
relation to Fig. 1 1 namely the algorithms of a "filter having the minimum starting 
frequency of the stop band that satisfies the attenuation quantity of the stop band". 
Accordingly, as for this processing, the same marks as Fig.6 and Fig.l 1 are used. 
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Step 40 

As illustrated in Fig.24, firstly, an initial setting is executed (F 301). In this initial 
setting, setting of a linear-phase FIR filter, setting of a band, setting of a coefficient of the 
pre-filter, setting of the initial extreme value point, designation of attenuation quantity of 
the stop band, and setting of initial frequency of dichotomizing method are executed. 

Concrete items thus set are as follows: 

• the number of taps 

• linear-phase FIR filter with even symmetry or odd symmetry 

• the number of the band is two 

• the starting frequency of the pass band co = 0 

• gain of the pass band 

• the end frequency of the stop band cd = n 

• gain of the stop band 

• weighting to the pass band and the stop band 

• coefficient of the pre-filter 

• attenuation quantity dBs of the stop band (namely, pointing largeness 82 of 
ripple of the stop band) 

• frequency coc of the transition band and attenuation quantity dBc thereof 

• frequency <o (0) = co k (0) (k = 0, .. , R) that becomes the extreme value in the 
approximation band. The provided letter of the right shoulder (i) expresses the number of 
repetition. 

Also, Fig.26 is a view illustrating initial frequency of the dichotomizing method 
in the algorithms for finding a filter that causes the signal to pass the frequency point of 
the transition band, and that satisfies the attenuation quantity of the stop band. 

As illustrated in Fig.26, in the present example, the following values are given as 
the initial frequencies of the dichotomizing method. 

the vicinity of a starting frequency of the pass band (52) 
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a^; tfr L«J * the vicinity of coc (53) 

A portion of [t] at the back of cop expresses the number of cycle. 

Here, the Remez Exchange algorithms taking into account the frequency response 
of the pre-filter are executed to the frequency &> ^ re ^ [0 ]| ; thus the minimum 
starting frequency <W j p/ ^[o] of the stop band that satisfies the designated 
attenuation quantity dBs in me stop band is found, the gain c^ cyr '[o] corresponding 
to coc at this time is found. The following steps are explained on the basis of this 
assumption. 

Step 41 

The algorithms for finding a "filter having the minimum starting frequency of the 
stop band that satisfies the attenuation quantity of the stop band" is executed (F 102, F 
103, F 104, F206, F 207, F 208). 

Concretely, in the processing F 102, an interpolation polynomial expression is 
generated for interpolating an amplitude characteristic from the extreme value point at the 
time of 0) { ; ur) [t]. 

Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing F 104, repetition judgement of the Remez Exchange 
algorithms is executed. 

Next, in the processing F 206, the minimum attenuation quantity is found in the 
stop band. 

Next, in the processing F 207, an end condition of the algorithms for finding a 
filter having the minimum starting frequency cos of the stop band that satisfies the 
attenuation quantity of the stop band is obtained. 

Also, in the processing F 208, setting of the starting frequency ^ {cur) 

s 

of the new stop band is executed. 
Step 42 

Next, the attenuation quantity of the frequency that is designated as the transition 
band (F 309) is examined. 
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In the processing F 102, the attenuation quantity c \}\ 
to the frequency «c which is designated as the transition band While using LaGrange's 
interpolation polynomial expression found finally with the algorithms for finding "the 
minimum starting frequency of the stop band that satisfies the attenuation quantity of the 
stop band" is examined. 



Comparison to the designated attenuation quantity of the transition band is 
executed (F 310). 

Concretely, in the case that the result of the comparison satisfies following 
equations (54) or (55) processing is moved to processing of Step 45 (F 105). While when 
the result of the comparison does not satisfy equations (54) or (55), processing is moved 
to processing of Step 44 (F 311). 



Provided that si and e2 are extremely small values. 
Step 44 

Setting of the band is changed when the result of the comparison does not satisfy 
equations (54) or (55), in the comparison between the frequency wc of the transition band 
and the attenuation quantity dBc (F 3 1 1) 

Concretely, the end frequency pi J 
of a new pass band is set. Explanation is performed while dividing into two cases of the 
first loop and the second loop as the setting method. 

First time: 

In the case of the first time, there are three cases illustrated in Figs.27A to 27C. 
Namely, cases illustrated in Fig.27A, Fig.27B, and Fig.27C are considered to 



Step 43 



C54) 



k-W-.i~WK<> 



frequencies 
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The case illustrated in Fig.27A is one in which both satisfy the designated 
attenuation quantity dBc. In this case, the large frequency coj COr ^ qJ ' is taken to be 
solution, thus advancing toward the processing of Step 45. 

The case illustrated in Fig.27B is one in which both do not satisfy the designated 
attenuation quantity. In this case, the present number of taps cannot realize the designated 
attenuation quantity. Accordingly, that effect is indicated to end. 

The case illustrated in Fig.27C is one in which only one side satisfies the 
designated attenuation quantity. In this case, processing is moved to Step 41 in such a 
way as following equation (56). 

Further, in the present method for giving initial frequency point, there does not 
exist the case in which a/ Ci "^[o] is satisfied and <^ r ^[o] is not 
satisfied. 



Second time and later: 

In the case of a second time and later, two cases indicated in Figs.28A and 28B 
are considered. In the determining method of the new frequency (O^^t + f J in the 
second time and later, the frequency which satisfies the attenuation quantity aBc thus 
designated is preserved invariably within Q)^[f + l] ■ . The case illustrated in 
Fig.28A, the characteristic shown in Fig.28B is considered to the frequencies qj (p**)^ J ^ 

The case illustrated in Fig.28A is one in which one side satisfies the designated 
attenuation quantity. In this case, the processing is moved to next the step 41 in such a 
way as the following equation (57). 

Further, since the frequency which satisfies the designated attenuation quantity 
always conforms to 15 U)p Pr *\t ] , the case that . c^ pr ^[f] does not satis fy does 
not exist. 
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o^'i; + x(4 w) [/]+ wJrt'D (57) 

The case illustrated in Fig.28B is one in which the both satisfies the designated 
attenuation quantity. In this case, the processing is moved to next step 41 in such a way 
as the following equation (58). 

»jrl* +i]«a>j^ ess) 

Step 45 

The coefficients of the linear-phase FIR filter is found from the approximated 
amplitude characteristic (F 105). 

Namely, the coefficients of the linear-phase FIR filter are found from the 
amplitude characteristic obtained finally. 

Fig.29 is a view illustrating a frequency response characteristic of the low-pass 
filter obtained from the algorithms for finding a "filter that satisfies the attenuation 
quantity of the stop band and that causes the signal to pass the frequency point of the 
transition band" on the basis of the algorithms for finding a "filter having the minimum 
starting frequency of the stop band while taking the filter of the zero point for avoiding 
the chessboard distortion". 

Fundamental algorithms, variables intended to find, and band of this case are as 
follows: 

Fundamental algorithms 

It is the Remez Exchange algorithms for finding the minimum starting frequency 
of the stop band that satisfy the attenuation quantity of the stop band. 

• passing through (0.4 n, 12 dB) 

• 24 taps 
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ar x [yj- the vicinity of end frequency of the block band (59) 

The other side of W jp] * s one which is found with the algorithms 

for searching a "filter having ine minimum starting frequency of the stop band that 
satisfies the attenuation quantity of the stop band" as the value described later. Namely, 
cos which is found by the above algorithms is taken to be 



i> L J ~ th e vicinity of starting frequency of the pass band (60) 

It should be noted that cop should be made to search as later described in equation 
(61) essentially, however, cop that satisfies the attenuation quantity of the stop band can 
not be found. Accordingly, since the minimum value of the cop is degree of 0.01, the 
starting frequency cos of the stop band that satisfies the attenuation quantity of the stop 
band at this time is taken to be the initial frequency. 



w * "IMI ° the vicinity of coc (61) 

The portion of [t] at the back of cos expresses the number of cycle. 

Here, the Remez Exchange algorithms taking into account the frequency response 
of the pre-filter are executed to the frequency o> j'^fo] , > thus the maximum 
end frequency [o] 07 °^ * e pass ban( * * at sat * sf i es the designated attenuation 
quantity dBs in the stop band is found, and the gain <#^ C£/r )[o] corresponding to coc at 
this time is found. The following steps are explained on the basis of this assumption. 

Step 51 

The algorithms for finding a "filter having the maximum end frequency of the 
pass band that satisfies the attenuation quantity of the stop band" is executed (F 102, F 
103, F 104, F206, F 207, F 208). 

Concretely, in the processing F 102, an interpolation polynomial expression is 
generated for interpolating an amplitude characteristic from the extreme value point at the 
time of r,A cur )W\ 
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Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing F 104, repetition judgement of the Remez Exchange 
algorithms is executed. 

Next, in the processing F 206, the minimum attenuation quantity is found in the 
stop band. 

Next, in the processing F 207, an end condition of the algorithms for finding a 
filter having the minimum starting frequency cos of the stop band that satisfies the 
attenuation quantity of the stop band is obtained. 

Also, in the processing F 208, setting of the starting frequency qj (our- ) 
of the new stop band is executed. 



Next, the attenuation quantity of the frequency that is designated as the transition 
band (F 309) is examined. 

In the processing F 102, the attenuation quantity 
to the frequency coc which is designated as the transition band while using LaGrange's 
interpolation polynomial expression found finally with the algorithms for finding "the 
maximum end frequency of the stop band that satisfies the attenuation quantity of the 
stop band" is examined. 



Comparison to the designated attenuation quantity of the transition band is 
executed (F310). 

Concretely, in the case that result of the comparison satisfies the following 
equations (62) or (63) processing is moved to processing of Step 55 (F 105). When the 
result of the comparison does not satisfy equations (62) or (63), processing is moved to 
processing of Step 54 (F 31 1). 



Step 52 



Step 53 




(€2) 
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Provided that si and e2 are extremely small values. 
Step 44 

Setting of the band is changed when the result of the comparison does not satisfy 
equations (62) or (63), in the comparison between the frequency ©c of the transition band 
and the attenuation quantity dBc (F 31 1) . 

Concretely, the end frequency co [ s cur) [t + t] of a new pass band is made to set. 
Explanation is provided while dividing into two cases of the first loop and the second 
loop as the setting method. 

First time: 

In the case of the first time, there are three cases illustrated in Figs.32A to 32C. 

Namely, cases illustrated in Fig.32A, Fig.32B, and Fig.32C are considered to 
frequencies ^[o] 

The case illustrated in Fig.32A is one in which both satisfy the designated 
attenuation quantity dBc. In this case, the large frequency w j ct/r ^o] is taken to be a 
solution, thus advancing toward the processing of Step 55. 

The case illustrated in Fig.32B is one in which both do not satisfy the designated 
attenuation quantity. In this case, the present number of taps cannot realize the designated 
attenuation quantity. Accordingly, that effect is indicated to end. 

The case illustrated in Fig.32C is one in which only one side satisfies the 
designated attenuation quantity. In this case, processing is moved to Step 51 in such a 
way as following equation (64). 

Further, in the present method for giving an initial frequency point, the case does 



not exist in which 




is not satisfied. 



at^-^U^^^ (64) 
d$**[l]-dB^[o] 
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• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 40 dB 
Variables intended to find 

It is the end frequency cop of the pass band and the starting frequency cos of the 
stop band. 

[Table 6} 

Band 



band 


Frequency region 


gain 


weight 


Pass band 




1 


1 


Stop band 




0 


1 



Further, in Fig.29, the solid line satisfies the attenuation quantity of the stop band 
and indicates a frequency response of a low-pass filter causing the frequency point of the 
transition band to pass through. 

Furthermore, the black circle indicates the designated frequency point. Also, the 
dotted line indicates a frequency which becomes zero point for avoiding the chessboard 
distortion. 

As known from Fig.29, the low-pass filter which is obtained from the algorithms 
for finding a "filter that causes the signal to pass the frequency point of the transition 
band and that satisfies the attenuation quantity of the stop band" on the basis of a "filter 
having the minimum starting frequency of the stop band" has good frequency response 
characteristic. 

Subsequently, as for algorithms on the basis of the algorithms for finding a filter 
having the maximum end frequency of the pass band that satisfies the attenuation 
quantity of the stop band, explanation is made in relation to Fig.24, Fig.30 to Figs.33A 
and 33B. 
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The flowchart of this case is equivalent to Fig. 24 which is referred to in the 
algorithms for finding a filter that causes the signal to pass the frequency point of the 
transition band and that satisfies the attenuation quantity of the stop band. 

Namely, the present algorithms utilize the algorithms for finding a "filter having 
the maximum end frequency of the pass band that satisfies the attenuation quantity of the 
stop band". 

In the concrete course of the algorithms, as illustrated in Fig.30, cop is obtained 
with the aforementioned algorithms as an inner loop, and a further loop for finding cos is 
put on outside thereof to determine parameter of the band. 

Namely, the outside loop causes the starting frequency cos of the stop band to be 
fixed, while the inner loop causes the end frequency cop of the pass band to be found that 
satisfies the attenuation quantity dBs of the stop band. 

When the amplitude characteristic thus found does not pass through the 
designated point (coc, dBc) of the transition band, cos is searched while using 
dichotomizing method like the case of searching a "filter having the minimum starting 
frequency of the stop band that satisfies the attenuation quantity of the stop band". 

Hereinafter, concrete algorithms are indicated, however, since the algorithms for 
finding a "filter having the maximum end frequency of the pass band that satisfies the 
attenuation quantity of the stop band" to be the inner loop is the same as that described 
above; thus description thereof is omitted. 

Also, the content of Fig.24 and each step processing F 102, F 103, F 104, and F 
105 of the algorithms explained below, like the case of the first approach, is the same as 
the Remez Exchange algorithms taking into account the frequency response of the pre- 
filter explained in relation to Fig.6. Further, the content of each processing F 206, F 207, 
F 208, like the case of the second approach, is the same as processing explained in 
relation to Fig. 1 1 namely the algorithms of a "filter having the minimum starting 
frequency of the stop band that satisfies the attenuation quantity of the stop band". 
Accordingly, as for this processing, the same marks as Fig.6 and Fig.l 1 are used. 
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Step 50 

As illustrated in Fig.24, firstly, an initial setting is executed (F 301). In this initial 
setting, setting of the linear-phase FIR filter, setting of the band, setting of the coefficient 
of the pre-filter, setting of the initial extreme value point, designation of the attenuation 
quantity of the stop band, and setting of the initial frequency of dichotomizing method 
are executed. 

Concrete items thus set are as follows: 

• the number of taps 

• linear-phase FIR filter with even symmetry or odd symmetry 

• the number of the band is two 

• the starting frequency of the pass band oo = 0 

• gain of the pass band 

• the end frequency of the stop band w = n 

• gain of the stop band 

• weighting to the pass band and the stop band 

• coefficient of the pre-filter 

• attenuation quantity dBs of the stop band (namely, pointing largeness 52 of 
ripple of the stop band) 

• frequency oc of the transition band and attenuation quantity dBc thereof 

• frequency co (0) = co k (0) (k = 0, , R) that becomes the extreme value in the 
approximation band. The provided letter of right shoulder (i) expresses the number of 
repetition. 

Also, Fig.31 is a view illustrating an initial frequency of the dichotomizing 
method in the algorithms for finding filter that causes the signal to pass through the 
frequency point of the transition band, and that satisfies the attenuation quantity of the 
stop band. 

As illustrated in Fig.31, in the present example, the following values are given as 
the initial frequencies of the dichotomizing method. 
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Second time and later: 

In the case of a second time and later, two cases indicated in Figs.33A and 33B 
are considered. In the determining method of the new frequency ^^[t 4- 1] in the 
second time and later, the frequency which satisfies the attenuation quantity dBc thus 
designated is preserved invariably within ^"'[f + l] . • The case illustrated in 
Fig.33A, Fig.33B is considered to the frequencies ^ (p^)^ J ^ (c^)j^j 

The case illustrated in Fig.33A is one in which one side sausnes uie designated 
attenuation quantity. In this case, the processing is moved to a next step 51 in such a way 
as the following equation (65). 

Further, since the frequency that satisfies the designated attenuation quantity 
always conforms to 5 ^ (^] , the case that ^ (^j does not satisfy does 
not exist. 



4*4 *l]«05x^^ (65) 

The case illustrated in Fig.33B is a case that both satisfy the designated 
attenuation quantity. In this case processing is moved to next step 51 in accordance with 
following equation (66). 

dt£**[i+\]~dtfr%] 

Step 55 

The coefficients of the linear-phase FIR filter are found from the approximated 
amplitude characteristic (F 105). 
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Namely, the coefficients of the linear-phase FIR filter are found from the 
amplitude characteristic obtained finally. 

Fig.34 is a diagram illustrating frequency response characteristic of the low-pass 
filter obtained from the algorithms for finding a "filter that satisfies the attenuation 
quantity of the stop band and that enables the signal to be passed through the frequency 
point of the transition band" on the basis of the algorithms for finding a "filter having the 
maximum end frequency of the pass band" with the filter of zero point for avoiding the 
chessboard distortion to be the pre-filter. 

Fundamental algorithms, variables intended to find, and band of this case are as 
follows: 

Fundamental algorithms 

It is the Remez Exchange algorithms for finding the minimum starting frequency 
of the stop band that satisfies the attenuation quantity of the stop band. 
■ passing through (0.4 n, 12 dB) 

• 24 taps 

• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 40 dB 
Variables intended to find 

It is the end frequency cop of the pass band and the starting frequency cos of the 
stop band. 

[Table 7] 

Band 



band 


Frequency region 


gain 


weight 


Pass band 




1 


1 


Stop band 




0 


1 
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Further, in Fig.34, the solid line satisfies the attenuation quantity of the stop band 
and indicates a frequency response of a low-pass filter causing the signal to be passed 
through the frequency point of the transition band. 

Furthermore, the black circle indicates the designated frequency point. Also, 
dotted line indicates a frequency which becomes a zero point for avoiding the chessboard 
distortion. 

As known from Fig.34, the low-pass filter which is obtained from the algorithms 
for finding a "filter that causes the signal to be passed through the frequency point of the 
transition band and that satisfies the attenuation quantity of the stop band" on the basis of 
a "filter having the minimum starting frequency of the stop band" has good frequency 
response characteristic. 

Subsequently, the algorithms for designing of filter in order to find filter with the 
minimum number of tap that satisfies attenuation quantity of the stop band will be 
explained against the Remez Exchange algorithms with a changeable band. 

Here, the algorithms for obtaining a filter having the minimum number of taps 
that satisfies an attenuation quantity of the designated stop band will be explained against 
the algorithms for obtaining a filter that has the maximum end frequency <op of the pass 
band, which end frequency satisfies an attenuation quantity of the stop band and against 
the algorithms for obtaining a filter having the minimum starting frequency cos of the stop 
band that satisfies the attenuation quantity of the stop band. 

Fig.35 is a view illustrating a flowchart of the algorithms for finding a filter with 
the minimum number of taps that realizes an attenuation quantity of the stop band. 

Here, a free parameter of this algorithms, an object, and a principle of the 
algorithms thus enumerated are as follows: 

* free parameter: 

• it is the number of taps 

• there exists two kinds of approaches. 

Firstly, the end frequency cop of the pass band is made to be variable, and 
the starting frequency cos of the stop band is made to be fixed. 
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Secondly, the end frequency cop of the pass band is made to be fixed, and 
the starting frequency cos of the stop band is made to be variable. 

• object: it is an object to obtain a filter having the minimum number of taps that 
satisfies an attenuation quantity dBs of the designated stop band to the algorithms in 
which one of the variables of the band is variable. 

• principle: When being given no-solution in one time of loop, it is impossible to 
satisfy the attenuation quantity of the designated stop band because the number of taps is 
short, an attempt is executed while increasing the number of tap by one. 

Also, the content of Fig.35 and each step processing F 102, F 103, F 104, and F 
105 of the algorithms explained below, like the case of the first approach, is the same as 
the Remez Exchange algorithms taking into account the frequency response of the pre- 
filter explained in relation to Fig.6. Further, the content of each processing F 201, F 206, 
F 207, F 208, like the case of the second approach, is the same as processing explained in 
relation to Fig.l 1 namely the algorithms of a "filter having the maximum end frequency 
of the pass band that satisfies the attenuation quantity of the stop band" and the 
algorithms of a "filter having the minimum starting frequency of the stop band that 
satisfies the attenuation quantity of the stop band". Accordingly, as for this processing, 
the same marks as Fig.6 and Fig.l 1 are used. 

Step 60 

As illustrated in Fig.35, firstly, an initial setting is executed (F 201). In this initial 
setting, setting of linear-phase FIR filter, setting of band, setting of coefficient of the pre- 
filter, setting of the initial extreme value point, designation of attenuation quantity of the 
stop band, and setting of initial frequency of dichotomizing method are executed. 

Concrete items thus set are as follows: 

• the number of taps 

• linear-phase FIR filter with even symmetry or odd symmetry 

• the number of the bands is two 

• the starting frequency of the pass band co = 0 
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• end frequency cop of the pass band in the case of the algorithms for finding a 
"filter having the minimum starting frequency of the stop band that satisfies the 
attenuation quantity of the stop band". 

• gain of the pass band 

• the end frequency of the stop band co = n 

• starting frequency cos of the stop band in the case of the algorithms for finding a 
"filter having the maximum end frequency of the pass band that satisfies the attenuation 
quantity of the stop band". 

• gain of the stop band 

• weighting in connection with the pass band and the stop band 

• coefficient of the pre-filter 

• attenuation quantity dBs of the stop band (namely, pointing largeness 82 of 
ripple of the stop band) 

• frequency co (0) = co k (0) (k = 0, , R) that becomes the extreme value in the 
approximation band. The provided letter of the right shoulder (i) expresses the number of 
repetition. 

• input of initial frequency of dichotomizing method 
Step 61 

The Remez Exchange algorithms taking into account the frequency response of 
the pre-filter are executed (F 102, F 103, F 104). 

Concretely, in the processing F 102, the interpolation polynomial expression is 
generated for interpolating an amplitude characteristic from the extreme value point. 

Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing F 104, repetition judgement of the Remez Exchange 
algorithms is executed. 

Step 62 

Next, the minimum attenuation quantity (the maximum weighted approximation 
error) of the stop band is obtained (F 206). 
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Step 63 

Discrimination is executed whether or not the end condition of the search of the 
frequency that satisfies the attenuation quantity of the designated stop band holds (F 207). 

When the end condition holds, processing is moved to Step 67 (F 105), while 
when the end condition does not hold, processing is moved to Step 64 (F 208). 

Step 64 

When the end condition does not hold in connection with the search algorithms of 
the frequency that satisfies the attenuation quantity of the designated stop band, the 
setting of the band is changed (F 208). 

Step 65 

Next, comparison to the attenuation quantity of the designated stop band is 
executed (F 414). 

In the setting change of the band in the processing F 208, in the case of no 
solution at the one time loop processing is moved to processing of Step 66 (F 414). While 
with the exception of the aforementioned case, processing is returned to processing of 
Step 61. 

Step 66 

One tap is increased (F 415). 

One tap is increased in addition to the present number of taps, thus processing is 
moved to initial setting processing of Step 60 (F 201). 
Step 67 

The coefficients of the linear-phase FIR filter is found from the approximated 
amplitude characteristic (F 105). 

Fig.36 is a view illustrating a frequency response characteristic of the low-pass 
filter obtained from the algorithms for finding "the minimum number of taps that satisfies 
attenuation quantity of the stop band" while taking the filter of the zero point for avoiding 
the chessboard distortion. 

Fundamental algorithms, variable intended to find, and bands of this case are as 
follows: 
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Fundamental algorithms 

It is the Remez Exchange algorithms taking into account frequency characteristic 
of the pre-filter for finding the filter which has the minimum starting frequency of the 
stop band that satisfies the attenuation quantity of the stop band. 

• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 60 dB 
Variable intended to find 

• it is the number N of tap. 

• the starting frequency cos of the stop band. 



[Table 81 

Band 



band 
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Pass band 
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Stop band 




0 


1 



Further, in Fig.36, the solid line indicates a frequency response of a low-pass filter 
of the minimum number of taps (14 taps) in which the attenuation quantity of the stop 

band becomes not more than -60 dB. Furthermore, the dotted line indicated by <D 

indicates frequency which becomes zero point for avoiding the chessboard distortion, and 
the dotted line indicated by Q> indicates period of the band given beforehand. 

As seen from Fig.36, the low-pass filter which is obtained from the algorithms for 
finding "the minimum number of tap which realizes attenuation quantity of the stop 
band" has a good frequency response characteristic. 

Furthermore, Fig.37 is a view illustrating frequency response characteristic of the 
low-pass filter obtained from the algorithms for finding "the minimum number of tap that 



75 



80001-2117 
CLEAN VERSION 



Attorney Docket No.: SON-2117 
Application No.: 09/874,061 



satisfies attenuation quantity of the designated stop band" while taking the filter of the 
zero point for avoiding the chessboard distortion. 

Fundamental algorithms, variable intended to find, and band of this case are as 
follows: 

Fundamental algorithms 

It is the Remez Exchange algorithms taking into account frequency characteristic 
of the pre- filter for finding the filter which has the maximum end frequency of the pass 
band that satisfies the attenuation quantity of the stop band. 

• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 60 dB 
Variable intended to find 

• it is the number N of tap. 

• the starting frequency cos of the stop band. 

[Table 9) 



band 
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Pass band 
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Stop band 
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1 



Further, in Fig.37, the solid line indicates a frequency response of a low-pass filter 
of the minimum number of taps (15 taps) in which the attenuation quantity of the stop 

band becomes not more than -60 dB. Furthermore, the dotted line indicated by <D 

indicates a frequency which becomes a zero point for avoiding the chessboard distortion, 
and the dotted line indicated by 0 indicates a period of the band given beforehand. 

As known from Fig.37, the low-pass filter which is obtained from the algorithms 
for finding "the minimum number of taps which realizes attenuation quantity of the 
designated stop band" has a good frequency response characteristic. 
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Subsequently, as the second modified example, explanation is provided about 
algorithms for finding a filter with the minimum numbers of taps that enables the signal 
to be pass through frequency point of transition band that satisfies attenuation quantity of 
the stop band. 

Here, algorithms for finding a filter with the minimum number of taps that 
satisfies the attenuation quantity of the block band and and that enables the signal to be 
passed through a frequency point of a transition band and to the algorithms for finding a 
"filter that satisfies the attenuation quantity of the block band and and that enables the 
signal to be passed through the frequency point of the transition band". 

Fig.38 is a view illustrating a flowchart of the algorithms for finding a filter with 
the minimum number of taps that satisfies the attenuation quantity of the stop band and 
that enables the signal to be passed through the frequency band of the transition band. 

Here, a free parameter of this algorithm, an object, and principle of the algorithms 
thus enumerated are as follows: 

* free parameter: 

• it is the number of taps 

• the end frequency cop of the pass band. 

• the starting frequency cos of the stop band 

* object: it is an object to obtain a filter having the minimum number of taps that 
satisfies an attenuation quantity dBs of the designated stop band and that the attenuation 
quantity dBc is passed at the frequency coc of the transition band. Namely, the maximum 
end frequency cop of the pass band so as to become the attenuation quantity dBc at the 
designated frequency coc of the transition band and the minimum starting frequency cos of 
the stop band are determined to obtain the filter with the minimum number of taps. 

* principle: When being given no-solution in one time of a loop, it is impossible 
to satisfy the attenuation quantity because the number of taps is short, attempt is executed 
while increasing the number of taps by one. Further, in cases where it is impossible to 
realize the frequency point of the transition band, an attempt is executed while increasing 
the number of taps by one. 
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Also, the content of Fig.38 and each step processing F 103, F 104, and F 105 of 
the algorithms explained below, like the case of the first approach, is the same as the 
Remez Exchange algorithms taking into account the frequency response of the pre-filter 
explained in relation to Fig.6. Further, the content of each processing F 201, F 206, F 
207, F 208, like the case of the second approach, is the same as processing explained in 
relation to Fig.l 1, namely the algorithms of a "filter having the maximum end frequency 
of the pass band that satisfies the attenuation quantity of the stop band" or the algorithms 
of a "filter having the minimum starting frequency of the stop band that satisfies the 
attenuation quantity of the stop band". Further, the contents of the processing F 301, F 
309, F 310, and F 31 1 are the same as the processing explained in relation to Fig.24, 
namely, the same as the algorithms for finding the filter that satisfies the attenuation 
quantity, and, in which a designated attenuation quantity is passed through at the 
designated frequency of the transition band. Accordingly, as for this processing, the same 
marks as Fig.6 Fig.l 1 and Fig.24 are used. 

Step 70 

As illustrated in Fig.38, firstly, initial setting is executed (F 301). Concretely, 
initial setting of the algorithms is executed for finding the filter that satisfies the 
attenuation quantity of the stop band, and in which designated attenuation quantity is 
passed through of the transition band. 

Concrete items thus set are as follows: 

• the number of tap 

• linear-phase FIR filter with even symmetry or odd symmetry 

• the number of the band is two 

• the starting frequency of the pass band co = 0 

• gain of the pass band 

• the end frequency of the stop band co = n 

• gain of the stop band 

• weighting to the pass band and the stop band 

• coefficient of the pre-filter 
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• attenuation quantity dBs of the stop band (namely, pointing largeness 52 of 
ripple of the stop band) 

• frequency coc of the transition band and attenuation quantity dBc thereof 

• frequency co (0) = co k (0) (k = 0, .. , R) that becomes the extreme value in the 
approximation band. Provided letter of right shoulder (i) expresses the number of 
repetition. 

• input of initial frequency of dichotomizing method. 
Step 71 

The Remez Exchange algorithms taking into account the frequency response of 
the pre-filter is executed (F 102, F 103, F 104). 

Concretely, in the processing F 102, interpolation polynomial expression is generated for 
interpolating an amplitude characteristic from the extreme value point. 

Subsequently, in the processing F 103, the new extreme value point is determined 
from the amplitude characteristic obtained from the interpolation polynomial expression. 

Then, in the processing F 104, repetition judgement of the Remez Exchange 
algorithms is executed. 

Step 72 

Next, the minimum attenuation quantity (the maximum weighted approximation 
error) of the stop band is obtained (F 206). 
Step 73 

Discrimination is executed whether or not the end condition of the search of the 
frequency that satisfies the attenuation quantity of the designated stop band holds (F 207). 

When the end condition holds, processing is moved to Step 77 (F 309), while 
when the end condition does not hold, processing is moved to Step 74 (F 208). 

Step 74 

When the end condition does not hold in connection with the search algorithms of 
the frequency that satisfies the attenuation quantity of the designated stop band, setting of 
the band is changed (F 208). 
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Step 75 

Next, comparison between the attenuation quantity of the designated stop band 
and obtained attenuation quantity is executed (F 414). 

In change of the setting of the band in the processing F 208, in the case of no 
solution at the one time of the loop, processing is moved to processing of Step 76 (F 
415). In the cases with the exception of the aforementioned case, processing is returned to 
processing of Step 71. 

Step 76 

One tap is increased (F 415). 

One tap is increased in addition to the present number of tap, thus processing is 
moved to initial setting processing of Step 70 (F 301). 
Step 77 

When the end condition of the search algorithms of the frequency that satisfies 
designated attenuation quantity of the stop band holds, attenuation quantity of the 
frequency which is designated to the transition band is examined (F 309). 

Comparison between the attenuation quantity of the designated stop band and 
obtained attenuation quantity is performed (F 414). 

When the end condition holds, processing is moved to Step 82 (F 105),while when the 
end condition does not hold, processing is moved to Step 79 (F 3 1 1). 
Step 79 

When the end condition does not hold, setting of the band is changed (F 3 1 1). ~. . 
Step 80 

Next, comparison between the attenuation quantity of the designated stop band 
and obtained attenuation quantity is executed (F 416). 

In change of the setting of the band in the processing F 31 1, in the case of no 
solution at the one time of the loop, processing is moved to processing of Step 81 (F 
417). In the cases with the exception of the aforementioned case, processing is returned to 
processing of Step 71. 

Step 81 

One tap is increased (F 417). 
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One tap is increased in addition to the present number of tap, thus processing is 
moved to initial setting processing of Step 70 (F 301). 
Step 83 

The coefficients of the linear-phase FIR filter is found from the approximated 
amplitude characteristic (F 105). 

Fig.39 is a diagram illustrating frequency response characteristic of the low-pass 
filter obtained from the algorithms for finding "filter with the minimum number of taps 
which filter satisfies the attenuation quantity of the stop band, and which filter enables 
the signal to be passed through the frequency point of the transition band" with the filter 
of zero point for avoiding the chessboard distortion to be the pre-filter. 

Fundamental algorithms, variable intended to find, and band of this case are as 
follows: 

Fundamental algorithms 

It is the Remez Exchange algorithms for obtaining a filter that enables the signal 
to be passed through the frequency point of the transition band on the basis of the 
algorithms for obtaining the filter that satisfies the attenuation quantity of the stop band 
that has the maximum end frequency of the pass band. 

• passing through (0.4 n, 12 dB) 

• even symmetry 

• U = 3 (filter coefficient is executed U times 
such that DC gain becomes U) 

• attenuation quantity of the stop band is not more than - 60 dB 
Variable intended to find 

• it is the number of taps N. 

• the end frequency ©p of the pass band. 

• the starting frequency ws of the stop band. 
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1 



Further, in Fig.39, the solid line indicates frequency response of low-pass filter of 
the minimum number of tap (17 taps) in which the attenuation quantity of the stop band 
becomes not more than -60dB, and the attenuation quantity becomes not more than -12dB 
on the frequency 0.4n of the transition band. Further, dotted line indicates the frequency 
that becomes zero point in order to avoid the chessboard distortion, the black circle 
indicates the designated frequency point of the transition band. 

As seen from Fig.39, the low-pass filter which is obtained from the algorithms for 
finding "filter with the minimum number of taps which filter satisfies attenuation 
quantity of the stop band, and which filter enables the signal to be passed through the 
frequency point of the transition band" has good frequency response characteristic. 

As described-above, according to the present invention, there is an advantage that 
is possible to stably preserve weighted approximation error in such a way that equi-ripple 
is not broken in comparison with the conventional method. Further, there is an advantage 
that is possible to preserve gain of the pass band into a constant value in comparison with 
the conventional method. 

While the invention has been described with reference to specific embodiment 
chosen for purpose of illustration, it should be apparent that numerous modifications 
could be made thereto by those skilled in the art without departing from the basic concept 
and scope of the invention. 
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